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Fourier and Laplace Transforms 


This book presents in a unified manner the fundamentals of both continuous and 
discrete versions of the Fourier and Laplace transforms. These transforms play an 
important role in the analysis of all kinds of physical phenomena. As a link between 
the various applications of these transforms the authors use the theory of signals and 
systems, as well as the theory of ordinary and partial differential equations. 

The book is divided into four major parts: periodic functions and Fourier series, 
non-periodic functions and the Fourier integral, switched-on signals and the Laplace 
transform, and finally the discrete versions of these transforms, in particular the Dis¬ 
crete Fourier Transform together with its fast implementation, and the z-transform. 
Each part closes with a separate chapter on the applications of the specific transform 
to signals, systems, and differential equations. The book includes a preliminary part 
which develops the relevant concepts in signal and systems theory and also contains 
a review of mathematical prerequisites. 

This textbook is designed for self-study. It includes many worked examples, to¬ 
gether with more than 450 exercises, and will be of great value to undergraduates 
and graduate students in applied mathematics, electrical engineering, physics and 
computer science. 
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Preface 


This book arose from the development of a course on Fourier and Laplace 
transforms for the Open University of the Netherlands. Originally it was the 
intention to get a suitable course by revising part of the book Analysis and 
numerical analysis, part 3 in the series Mathematics for higher education 
by R. van Asselt et al. (in Dutch). However, the revision turned out to be so 
thorough that in fact a completely new book was created. We are grateful 
that Educaboek was willing to publish the original Dutch edition of the book 
besides the existing series. 

In writing this book, the authors were led by a twofold objective: 

- the ‘didactical structure’ should be such that the book is suitable for those 
who want to learn this material through self-study or distance teaching, 
without damaging its usefulness for classroom use; 

- the material should be of interest to those who want to apply the Fourier 
and Laplace transforms as well as to those who appreciate a mathematically 
sound treatment of the theory. 

We assume that the reader has a mathematical background comparable 
to an undergraduate student in one of the technical sciences. In particular 
we assume a basic understanding and skill in differential and integral cal¬ 
culus. Some familiarity with complex numbers and series is also presumed, 
although chapter 2 provides an opportunity to refresh this subject. 

The material in this book is subdivided into parts. Each part consists of a 
number of coherent chapters covering a specific part of the field of Fourier 
and Laplace transforms. In each chapter we accurately state all the learning 
objectives, so that the reader will know what we expect from him or her when 
studying that particular chapter. Besides this, we start each chapter with an 
introduction and we close each chapter with a summary and a selftest. The 
selftest consists of a series of exercises that readers can use to test their own 
knowledge and skills. For selected exercises, answers and extensive hints 
will be available on the CUP website. 

Sections contain such items as definitions, theorems, examples, and so on. 
These are clearly marked in the left margin, often with a number attached to 
them. In the remainder of the text we then refer to these numbered items. 
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Preface 


For almost all theorems proofs are given following the heading Proof. The 
end of a proof is indicated by a right-aligned black square: ■. In some cases 
it may be wise to skip the proof of a theorem in a first reading, in order not 
to lose the main line of argument. The proof can be studied later on. 

Examples are sometimes included in the running text, but often they are 
presented separately. In the latter case they are again clearly marked in the 
left margin (with possibly a number, if this is needed as a reference later on). 
The end of an example is indicated by a right-aligned black triangle: ◄. 

Mathematical formulas that are displayed on a separate line may or may 
not be numbered. Only formulas referred to later on in the text have a number 
(right-aligned and in brackets). 

Some parts of the book have been marked with an asterisk: *. This con¬ 
cerns elements such as sections, parts of sections, or exercises which are 
considerably more difficult than the rest of the text. In those parts we go 
deeper into the material or we present more detailed background material. 
The book is written in such a way that these parts can be omitted. 

The major part of this book has been written by Dr R.J. Beerends and 
Dr H.G. ter Morsche. Smaller parts have been written by Drs J.C. van 
den Berg and Ir E.M. van de Vrie. In writing this book we gratefully used 
the comments made by Prof. Dr J. Boersma and the valuable remarks of 
Ir G. Verkroost, Ir R. de Roo and Ir F.J. Oosterhof. 

Finally we would like to thank Drs A.H.D.M. van Gijsel, E.D.S. van den 
Heuvel, H.M. Welte and P.N. Truijen for their unremitting efforts to get this 
book to the highest editorial level possible. 



Introduction 


Fourier and Laplace transforms are examples of mathematical operations which can 
play an important role in the analysis of mathematical models for problems orig¬ 
inating from a broad spectrum of fields. These transforms are certainly not new, 
but the strong development of digital computers has given a new impulse to both 
the applications and the theory. The first applications actually appeared in astron¬ 
omy, prior to the publication in 1822 of the famous book Theorie analytique de la 
chaleur by Joseph Fourier (1768 - 1830). In astronomy, sums of sine and cosine 
functions were already used as a tool to describe periodic phenomena. However, in 
Fourier’s time one came to the surprising conclusion that the Fourier theory could 
also be applied to non-periodic phenomena, such as the important physical problem 
of heat conduction. Fundamental for this was the discovery that an arbitrary func¬ 
tion could be represented as a superposition of sine and cosine functions, hence, of 
simple periodic functions. This also reflects the essential starting point of the vari¬ 
ous Fourier and Laplace transforms: to represent functions or signals as a sum or an 
integral of simple functions or signals. The information thus obtained turns out to 
be of great importance for several applications. In electrical networks, for example, 
the sinusoidal voltages or currents are important, since these can be used to describe 
the operation of such a network in a convenient way. If one now knows how to 
express the voltage of a voltage source in terms of these sinusoidal signals, then this 
information often enables one to calculate the resulting currents and voltages in the 
network. 

Applications of Fourier and Laplace transforms occur, for example, in physical 
problems, such as heat conduction, and when analyzing the transfer of signals in var¬ 
ious systems. Some examples are electrical networks, communication systems, and 
analogue and digital filters. Mechanical networks consisting of springs, masses and 
dampers, for the production of shock absorbers for example, processes to analyze 
chemical components, optical systems, and computer programs to process digitized 
sounds or images, can all be considered as systems for which one can use Fourier 
and Laplace transforms as well. The specific Fourier and Laplace transform being 
used may differ from application to application. For electrical networks the Fourier 
and Laplace transforms are applied to functions describing a current or voltage as 
function of time. In heat conduction problems, transforms occur that are applied 
to, for example, a temperature distribution as a function of position. In the mod¬ 
ern theory of digital signal processing, discrete versions of the Fourier and Laplace 
transforms are used to analyze and process a sequence of measurements or data, 
originating for example from an audio signal or a digitized photo. 

In this book the various transforms are all treated in detail. They are introduced 
in a mathematically sound way, and many mutually related properties are derived, 
so that the reader may experience not only the differences, but above all the great 
coherence between the various transforms. 

As a link between the various applications of the Fourier and Laplace transforms, 
we use the theory of signals and systems as well as the theory of ordinary and partial 
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Introduction 



FIGURE 0.1 

When digitizing a photo, information is lost. Conditions under which a good re¬ 
construction can be obtained will be discussed in part 5. Copyright: Archives de 
l’Academie des Sciences de Paris, Paris 


differential equations. We do not assume that the reader is familiar with systems 
theory. It is, however, an advantage to have some prior knowledge of some of the 
elementary properties of linear differential equations. 

Considering the importance of the applications, our first chapter deals with signals 
and systems. It is also meant to incite interest in the theory of Fourier and Laplace 
transforms. Besides this, part 1 also contains a chapter with mathematical prepara¬ 
tions for the parts to follow. Readers with a limited mathematical background are 
offered an opportunity here to supplement their knowledge. 

In part 2 we meet our first transform, specifically meant for periodic functions 
or signals. This is the theory of Fourier series. The central issue in this part is to 
investigate the information on a periodic function that is contained in the so-called 
Fourier coefficients, and especially if and how a periodic function can be described 
by these Fourier coefficients. The final chapter of this part examines some of the ap¬ 
plications of Fourier series in continuous-time systems and in solving ordinary and 
partial differential equations. Differential equations often originate from a physical 
problem, such as heat conduction, or from electrical networks. 

Part 3 treats the Fourier integral as a transform that is applied to functions which 
are no longer periodic. In order to construct a sound theory for the Fourier inte¬ 
gral - keeping the applications in mind - we can no longer content ourselves with 
the classical notion of a function. In this part we therefore pay special attention in 
chapters 8 and 9 to distributions, among which is the well-known delta function. 
Usually, a consistent treatment of the theory of distributions is only found in ad¬ 
vanced textbooks on mathematics. This book shows that a satisfactory treatment is 
also feasible for readers without a background in theoretical mathematics. In the 
final chapter of this part, the use of the Fourier integral in systems theory and in 
solving partial differential equations is explained in detail. 

The Laplace transform is the subject of part 4. This transform is particularly rel¬ 
evant when we are dealing with phenomena that are switched on. In the first chapter 
an introduction is given to the theory of complex functions. It is then easier for the 
reader to conceive of a Laplace transform as a function defined on the complex num¬ 
bers. The treatment in part 4 proceeds more or less along the same lines as in parts 2 
and 3, with a focus on the applications in systems theory and in solving differential 
equations in the closing chapter. 

In parts 2, 3 and 4, transforms were considered for functions defined on the 
real numbers or on a part of these real numbers. Part 5 is dedicated to the dis¬ 
crete transforms, which are intended for functions or signals defined on the integers. 
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These functions or signals may arise by sampling a continuous-time signal, as in the 
digitization of an audiosignal (or a photo, as in figure 0.1). In the first chapter of this 
part, we discuss how this can be achieved without loss of information. This results 
in the important sampling theorem. The second chapter in this part starts with the 
treatment of the first discrete transform in this book, which is the so-called discrete 
Fourier transform, abbreviated as DFT. The Fast Fourier Transform, abbreviated as 
FFT, is the general term for several fast algorithms to calculate the DFT numerically. 
In the third chapter of part 5 an FFT, based on the popular situation where the ‘length 
of the DFT' is a power of two, is treated extensively. In part 5 we also consider the 
z-transform, which plays an important role in the analysis of discrete systems. The 
final chapter is again dedicated to the applications. This time, the use of discrete 
transforms in the study of discrete systems is explained. 




Part 1 

Applications and foundations 
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CHAPTER 1 


Signals and systems 


INTRODUCTION 


Fourier and Laplace transforms provide a technique to solve differential equations 
which frequently occur when translating a physical problem into a mathematical 
model. Examples are the vibrating string and the problem of heat conduction. These 
will be discussed in chapters 5, 10 and 14. 

Besides solving differential equations, Fourier and Laplace transforms are im¬ 
portant tools in analyzing signals and the transfer of signals by systems. Hence, 
the Fourier and Laplace transforms play a predominant role in the theory of signals 
and systems. In the present chapter we will introduce those parts of the theory of 
signals and systems that are crucial to the application of the Fourier and Laplace 
transforms. In chapters 5, 10, 14 and 19 we will then show how the Fourier and 
Laplace transforms are utilized. 

Signals and systems are introduced in section 1.1 and then classified in sections 
1.2 and 1.3, which means that on the basis of a number of properties they will 
be divided into certain classes that are relevant to applications. The fundamental 
signals are the sinusoidal signals (i.e. sine-shaped signals) and the time-harmonic 
signals. Time-harmonic signals are complex-valued functions (the values of these 
functions are complex numbers) which contain only one frequency. These constitute 
the fundamental building blocks of the Fourier and Laplace transforms. 

The most important properties of systems, treated in section 1.3, are linearity 
and time-invariance. It is these two properties that turn Fourier and Laplace trans¬ 
forms into an attractive tool. When a linear time-invariant system receives a time- 
harmonic signal as input, the resulting signal is again a time-harmonic signal with 
the same frequency. The way in which a linear time-invariant system transforms a 
time-harmonic signal is expressed by the so-called frequency response, which will 
also be considered in section 1.3. 

The presentation of the theory of signals and systems, and of the Fourier and 
Laplace transforms as well, turns out to be much more convenient and much simpler 
if we allow the signals to have complex numbers as values, even though in practice 
the values of signals will usually be real numbers. This chapter will therefore as¬ 
sume that the reader has some familiarity with the complex numbers; if necessary 
one can first consult part of chapter 2, where the complex numbers are treated in 
more detail. 


7 



1 Signals and systems 


LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know what is meant by a signal and a system 

- can distinguish between continuous-time, discrete-time, real, complex, periodic, 
power, energy and causal signals 

- know what a sinusoidal and a time-harmonic signal are 

- are familiar with the terms amplitude, frequency and initial phase of a sinusoidal 
and a time-harmonic signal 

- know what is meant by the power- and energy-content of a signal and in particular 
know what the power of a periodic signal is 

- can distinguish between continuous-time, discrete-time, time-invariant, linear, 
real, stable and causal systems 

- know what is meant by the frequency response, amplitude response and phase 
response for a linear time-invariant system 

- know the significance of a sinusoidal signal for a real linear time-invariant system 

- know the significance of causal signals for linear time-invariant causal systems. 


1.1 Signals and systems 

To clarify what will be meant by signals and systems in this book, we will first 
consider an example. 

In figure 1.1a simple electric network is shown in which we have a series connec¬ 
tion of a resistor R, a coil L and a voltage generator. The generator in the network 


/(f) 



FIGURE 1.1 

Electric network with resistor, coil and voltage generator. 

supplies a voltage E(t ) and as a consequence a current i (f) will flow in the network. 
From the theory of electrical networks it follows that the current i ( t) is determined 
unambiguously by the voltage E(t), assuming that before we switch on the voltage 
generator, the network is at rest and hence there is no current flowing through the coil 
and resistor. We say that the current i (t) is uniquely determined by the voltage E (f). 
Using the Kirchhoff voltage-law and the current-voltage relationship for the resis¬ 
tor R and coil L, one can derive an equation from which the current /(f) can be 
calculated explicitly as a function of time. Here we shall not be concerned with this 
derivation and merely state the result: 

i(t) = -f e~ {t ~ T)R/L E(T)di. (1.1) 

L J— oo 

This is an integral relationship of a type that we shall encounter quite frequently 
in this book. The causal relation between E(t) and /(f) can be represented by the 
diagram of figure 1.2. The way in which i (f) follows from E(t) is thus given by the 
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E(t) 


/(f) 


> network 


► 


FIGURE 1.2 

The relation between £(t) and i(t). 

relation (1.1). Mathematically, this can be viewed as a mapping which assigns to a 
function E(t) the function i(t). In systems theory this mapping is called a system. 
The functions E(t ) and i ( t ) are called the input and output respectively. 

So a system is determined once the relationship is known between input and 
corresponding output. It is of no importance how this relationship can be realized 
physically (in our example by the electrical network). Often a system can even 
be realized in several ways. To this end we consider the mechanical system in 
figure 1.3, where a point-mass P with mass m is connected by an arm to a damper D. 
The point-mass P is acted upon by a force F(t). As a result of the force the point P 


D 


v[t) 


F(t) m 

- *o- 

P 


FIGURE 1.3 
Mechanical system. 

moves with velocity v(t). The movement causes a frictional force K in the damper 
which is proportional to the velocity v(t), but in direction opposite to the direction 
of v(f). Let k be the proportionality constant (the damping constant of the damper), 
then K = —kv(t). Using Newton's law one can derive an equation of motion for the 
velocity v(f). Given F(t ) one can then obtain from this equation a unique solution 
for the velocity v(f), assuming that when the force F(t) starts acting, the mechanical 
system is at rest. Again we shall not be concerned with the derivation and only state 
the result: 



( 1 . 2 ) 


Relation (1.2) defines, in the same way as relation (1.1), a system which assigns to 
an input F(t) the output v(f). But when R = k and L = m then, apart from the 
dimensions of the physical quantities involved, relations (1.1) and (1.2) are identical 
and hence the systems are equal as well. The realizations however, are different! 

This way of looking at systems has the advantage that the properties which can 
be deduced from a system apply to all realizations. This will in particular be the 
case for the applications of the Fourier and Laplace transforms. 

It is now the right moment to introduce the concept of a signal. The previous 
examples give rise to the following description of the notion of a signal. 


Signal 


A signal is a function. 

Thus, in the example of the electrical network, the voltage E(t) is a signal, which is 
defined as a function of time. The preceding description of the concept of a signal 
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is very general and has thus a broad application. It merely states that it is a function. 
Even the domain, the set on which the function is defined, and the range, the set of 
function-values, are not prescribed. For instance, the yearly energy consumption in 
the Netherlands can be considered as a signal. See figure 1.4. 



FIGURE 1.4 

Energy consumption in the Netherlands. 


Now that we have introduced the notion of a signal, it will also be clear from the 
foregoing what the concept of a system will mean in this book. 

System A system is a mapping L assigning to an input u a unique output y. 

It is customary to represent a system as a ‘black box’ with an input and an output 
(see figure 1.5). The output y corresponding to the input u is uniquely determined 
Response by u and is called the response of the system to the input u. 


u 

-► L 


V 


► 


FIGURE 1.5 
System. 


When y is the response of a system L to the input u, then, depending on the 
context, we use either of the two notations 

y = L u, 
u i->- y. 

Our description of the concept of a system allows only one input and one output. In 
general more inputs and outputs are possible. In this book we only consider systems 
with one input and one output. 

In the next section, signals will be classified on the basis of a number of 
properties. 
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Real signal 


Complex signal 


Null-signal 


Continuous-time signal 


Discrete-time signal 


1.2 Classification of signals 

The values that a signal can attain will in general be real numbers. This has been the 
case in all previous examples. Such signals are called real or real-valued signals. 
However, in the treatment of Fourier and Laplace transforms it is a great advantage 
to work with signals that have complex numbers as values. This means that we will 
suppose that a signal / has the form 


f = fl+ if2% 

where i is the imaginary unit for which i~ = — 1, and /j and / 2 are two real-valued 
signals. The signal f\ is called the real part of the complex signal f (notation 
Re /) and / 2 the imaginary part (notation Im /). If necessary, one can first con¬ 
sult chapter 2, where a review of the theory of complex numbers can be found. 
In section 1.2.2 we will encounter an important example of a complex signal, the 
so-called time-harmonic signal. 

Note that two complex signals are equal if the real parts and the imaginary parts 
of the complex signals agree. When for a signal / one has that / 2 = Im / = 0, 
then the signal is real. When /j = Re / = 0 and / 2 = Im / = 0, then the signal / 
is equal to zero. This signal is called the null-signal. 

Usually, the signals occurring in practice are real. Hence, when dealing with 
results obtained from the application of Fourier and Laplace transforms, it will be 
important to consider specifically the consequences for real signals. 


1.2.1 Continuous-time and discrete-time signals 

In electrical networks and mechanical systems, the signals are a function of the time- 
variable t, a real variable which may assume all real values. Such signals are called 
continuous-time signals. However, it is not necessary that the adjective continuous¬ 
time has any relation with time as a variable. It only expresses the fact that the 
function is defined on R or a subinterval of R. Hence, a continuous-time signal is a 
function defined on R or a subinterval of R. One should not confuse the concept of 
a continuous-time signal with the concept of a continuous function as it is used in 
mathematics. 

In the example of the yearly energy consumption in the Netherlands, the signal 
is not defined on R, but only defined for discrete moments of time. Such a signal 
can be considered as a function defined on a part of Z, which is the set of integers. 
In our example the value at n G Z is the energy consumption in year n. A signal 
defined on Z, or on a part of Z, will be called a discrete-time signal. 

As a matter of fact we assume in this book, unless explicitly stated otherwise, 
that continuous-time signals are defined on the whole of R and discrete-time signals 
on the whole of Z. In theory, a signal can always be extended to, respectively, the 
whole of R or the whole of Z. 

We denote continuous-time signals by f{t), g{t). etc. and discrete-time signals 
by f\n], g[n}. etc., hence using square brackets surrounding the argument n. 

The introduction of continuous-time and discrete-time signals that we have given 
above excludes functions of more than one variable. In this book we thus confine 
ourselves to signals depending on one variable only. As a consequence we also 
confine ourselves to systems where the occurring signals depend on one variable 
only. 
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Periodic continuous¬ 
time signal 

Periodic discrete¬ 
time signal 

Sinusoidal signal 


Amplitude 
Frequency 
Initial phase 


Modulus 

Argument 


Euler’s formula 


1.2.2 Periodic signals 

An important class of signals consists of the periodic signals. 

A continuous-time signal f(t) is called periodic with period T > 0 if 
fit + T) = f(t ) for t e R. 

A discrete-time signal f[n] is called periodic with period N e N if 
f[n + A] = f[n] for n e Z. 

In the class of periodic signals the so-called sinusoidal signals play an important 
role. These are real signals which, in the continuous-time case, can be written as: 

f(t) = A cos (cot + 4>q) for (el. 

Here A is the amplitude , at the (radial )frequency and <pQ the initial phase of the 
signal. The period T equals T = 2tc/ at. 

In the discrete-time case the sinusoidal signals have the form: 

f[n] = A cos (con + </>o) f° r n e N. 

Again A is the amplitude and (pQ the initial phase. The period N equals N — 2n/ai. 
From this it follows that at cannot be arbitrary since A is a natural number! 

We now introduce an important complex periodic signal which we will repeatedly 
come across in Fourier transforms. In order to do so, we will use Euler’s formula 
for complex numbers, which is treated extensively in chapter 2, but will also be 
introduced here in a nutshell. 

A complex number z = x+iy with real part x and imaginary part y is represented 
in the complex plane by a point with coordinates (x, y). Then the distance r = 
si x 2 + y 2 to the origin is called the modulus |z| of z, while the angle <p of the radius 
vector with the positive real axis is called the argument of z; notation tf> = arg z. The 
argument is thus determined up to an integral multiple of 2n. See figure 1.6. Using 



FIGURE 1.6 

Representation of a complex number in the complex plane. 

polar coordinates in the complex plane, the complex number z can also be written as 
z = r(cos f + i sin eft). For the complex number z = cos ij> + i sin f Euler's formula 
gives the following representation as a complex exponential: 

e'^ = cos (f> + i sirup. 
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Time-harmonic 
continuous-time signal 


Amplitude, frequency and 
initial phase of a 
time-harmonic signal 


Time-harmonic discrete-time 
signal 


Hence, a complex number z with modulus r and argument f can be written as 


This formula has major advantages. One can compute with this complex exponential 
as if it were a real exponential. The most important rule is the product formula. 
When z\ = r^e'^ 1 and Z 2 = then one has, as expected, 

Z\Z2 = rp^e 1 ^ 1 ^ 1 ^. 

This means that |ziZ21 — Izt11^21 an d arg(ztZ2) = argzi + ar gZ2- The latter 
relationship obviously only holds up to an integral multiple of 2jr. 

There are, however, also differences with the real exponential. For the real ex¬ 
ponential it follows from e x = e y that x = y. This does not hold for complex 
exponentials because e , ( < /’+ 27r ) — e ‘<l> f or all rea l since e~ ni = 1. 

In this chapter it is not our intention to go into the theory of complex numbers 
any further. We will return to this in chapter 2. The preceding part of the theory 
of complex numbers is only intended to allow the introduction of the following 
complex periodic signal. 

Let uel and c be a complex constant. The complex signal fit) is called a time- 
harmonic continuous-time signal when it is given by 

fit) = ce ia>r for t g R. 

If we write the complex number c as c = Ae‘^°, where A is the modulus of c and 
< Pq the argument, then the time-harmonic signal can also be written as follows: 

f(t) = Ae i(l>0 e i(ot = Ae i(fi>t+M . 

For a given value of t, one can represent fit) in the complex plane by a point on 
the circle having the origin as centre and A as radius. At time t = 0 the argument 
is equal to 4>q, the initial phase. In the complex plane the signal fit) corresponds 
to a circular movement with constant angular velocity \co\. See figure 1.7. The 
movement is in the clockwise direction if co < 0 and counter-clockwise if a> > 0. 
Note that the time-harmonic signal fit) is periodic with period 2n/ \ in |. The real 
number co is called the frequency of the time-harmonic signal, A the amplitude and 
< Pq the initial phase. Hence, the frequency can be negative and it then loses its 
physical meaning. In the complex plane the sign of co does indicate the direction of 
the circular movement and then | co | is the frequency. 

Above we introduced a time-harmonic signal in the continuous-time case. Simi¬ 
larly we define in the discrete-time case: 

Let co e R and c be a complex constant. The discrete-time signal / [n | is called a 
time-harmonic discrete-time signal when it is given by 

f[n] = ce iam for n e Z. 

In contrast to time-harmonic continuous-time signals, a time-harmonic discrete-time 
signal will in general not be periodic. Only when | co | = 2n/N for some positive 
integer N will the time-harmonic discrete-time signal be periodic with period N. 

A final remark we wish to make concerns the relationship between a time- 
harmonic signal and a sinusoidal signal. We only consider the continuous-time 
case; the discrete-time case follows from this by replacing t with the variable n. 
From Euler’s formula it follows that 

fit) = Ae ! T wf +0o) = A(cos(a>f + </>q) + 1 sin(o>f + <pf)). 
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(t = 0) 


> 



A 


FIGURE 1.7 
Time-harmonic signal. 

We conclude that a sinusoidal signal is the real part of a time-harmonic signal. A 
sinusoidal signal can also be written as a combination of time-harmonic signals. For 
this we use the complex conjugate z = x — iy of a complex number z = x + iy. 
Then the complex conjugate of e equals e~'^. Since cos (j> = ( e + e~ i( ^)/2, 
one has (verify this): 



1.2.3 Power and energy signals 

In electrical engineering it is customary to define the power of an element in an 
electric network, through which a current i (t) flows and which has a drop in voltage 
v(t), as the product i{t)v(t). The average power over the time-interval [fq, t\] then 
equals 

1 r‘ i 

- I i(t)v(t)dt. 

h - to Jt 0 

For a resistor of 1 ohm one has, ignoring the dimensions of the quantities involved, 
that v(f) = ((f), so that in this case the average power equals 



In signal theory this expression is called the average power of the signal i (t ) over the 
time-interval [fo, fj ]. The limiting-case, in which the average power is taken over 
ever increasing time-intervals, leads to the definition of the power of a signal. 
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Power (continuous-time) 


Power-signal 
( continuous-time) 


Power of a periodic 
continuous-time signal 


Energy-content 
( continuous-time) 

Energy-signal 
(continuous-time) 


Power (discrete-time) 


Power-signal (discrete-time) 


Power of a periodic 
discrete-time signal 


Energy-content 
(discrete-time) 

Energy-signal (discrete-time) 


The power P of a continuous-time signal /(f) is defined by 

P = Hm ' [ A | f(t) \ 2 dt. 

T-»oo LA J-A 


(1.3) 


If the power of a signal is finite, then the signal is called a power-signal. Notice 
that in equation (1.3) we have not used / 2 (f), but | f(t) The reason is that the 
power of a signal should not be negative, while for complex numbers the square 
could indeed become negative, since i 2 = —1, and could even result in a complex 
value. 

An example of a power-signal is a periodic signal. One can calculate the limit in 
(1.3) explicitly for a periodic signal /(f) with period T. We formulate the result, 
without proof, as follows. 

Let /(f) be a periodic continuous-time signal with period T. Then /(f) is a power- 
signal with power P equal to 

i r T / 2 

\f(0\ 2 dt. 

1 J-T/2 

Besides the power-signals, one also has the so-called energy-signals. In the pre¬ 
ceding example of the resistor of 1 ohm, the amount of energy absorbed by the 
resistor during the time-interval [fp, t\ ] equals 

f i 2 (t)dt. 

JtQ 

The definition of the energy-content of a signal concerns the time-interval — oo to 
oo. Hence, the energy-content of a continuous-time signal /(f) is defined by 

/ oo 

1/(0 I 2 dt. 

-oo 


A continuous-time signal with a finite energy-content is called an energy-signal. 


For discrete-time signals one uses analogous concepts. Integrals turn into sums. We 
will contend ourselves here with stating the definitions. 


The power P of a discrete-time signal f[n] is defined by 


P 


1 1 r 'I 

M—>oo 


1 

2 M 


M 

£ I/Ml 2 - 


n——M 


If the power of a discrete-time signal is finite, then the signal is called a power- 
signal. For a periodic discrete-time signal f\n\ with period N one has, as for the 
continuous-time case, that 

, N -1 
n =0 

The energy-content E of a discrete-time signal f[n] is defined by 

oo 

E= E I/Ml 2 - 

n =—oo 


If the energy-content of a signal is finite, then the signal is called an energy-signal. 
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1.1 


1.2 


1.3 

1.4 

1.5 

1.6 


1.7 

1.8 


1.2.4 Causal signals 

A final characteristic of a signal that we want to mention in this section has to do 
with causality. In the next section the concept of causality is also introduced for 
systems. In that context it will be easier to understand why the following definition 
of a causal signal is used. 

A continuous-time signal /(f), or a discrete-time signal f[n\ respectively, is called 
causal if 

/(f) — 0 for t < 0, 

f[n] = 0 for n < 0. 

Periodic signals are thus not causal, with the exception of the null-signal. If a signal 
has the property that /(f) = 0 for f < fq and some fq, then we call to the switch-on 
time of the signal /(f). Note that this definition does not fix the switch-on time 
uniquely. If a signal has the property that fit) = 0 for all t < 1, then besides t = 1 
as switch-on time, one can also use t = 0. Similar definitions apply to discrete-time 
signals. Notice that causal signals have switch-on time t = 0, or n = 0 in the 
discrete case. 

EXERCISES 

Given are the two sinusoidal signals f\(t) = A\ cos(a>t + <fii) and fi(t) = 
Ai cos(cof + tjyf) with the same frequency co. Show that the sum f\ (t) + / 2 (f) is also 
a sinusoidal signal with frequency co and determine its amplitude and initial phase. 

Show that the sunt of two time-harmonic signals f\{t) and / 2 (f) with the same fre¬ 
quency co and with amplitudes A\ and A 2 and initial phases <p\ and 02 respectively 
is again a time-harmonic signal with frequency co and determine its amplitude and 
initial phase. 

Show that the sum of two discrete-time sinusoidal signals with the same frequency is 
again a discrete-time sinusoidal signal and determine its amplitude and initial phase. 

Show that the sum of two discrete-time time-harmonic signals with the same fre¬ 
quency is again a discrete-time time-harmonic signal and determine its amplitude 
and initial phase. 

the power of the sinusoidal signal /(f) = A cos(cot + 0q). 

the energy-content of the signal /(f ) given by 

e~‘ for f > 0, 

0 for f < 0. 

the power of the periodic discrete-time signal /[«] = cos(«7r/2). 

the energy-content of the causal discrete-time signal f\n \ given by 

e~ n for n > 0, 

0 for n < 0. 


Calculate 

Calculate 

m = { 

Calculate 

Calculate 

m = j 


1.3 Classification of systems 

Besides signals one can also classify systems. It is customary to do this on the basis 
of the type of signals being processed by that system. 
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Continuous-time system 
Discrete-time system 


DEFINITION 1.1 

Linear system 


EXAMPLE 1.1 


EXAMPLE 1.2 


1.3.1 Continuous-time and discrete-time systems 

A continuous-time system is a system for which the input and output signals are 
continuous-time signals. 

A discrete-time system is a system for which the input and output signals are discrete¬ 
time signals. 

Discrete-time systems are of major importance in the modern field of digital signal 
processing (e.g. Van den Enden and Verhoeckx (in Dutch), 1987 - see Literature at 
the back of the book). 


1.3.2 Linear time-invariant systems 

We will now formulate two properties of systems that are crucial for the applica¬ 
tion of Fourier and Laplace transforms. The first property concerns the linearity of 
systems, while the second one concerns the time-invariance. 

A system L is called linear if for each two inputs u and v and arbitrary complex a 
and b one has 

L(au + bv) = aLu + bLv. (1.4) 

For continuous-time systems this property can be denoted as 
au(t) + bv(t) a(Lu)(t) + Z>(Lv)(f) 
and for discrete-time systems as 
au[n] + bv[n\ n(L«)[/?] + fe(Lv)[n]. 

Note that in the preceding linear combination au + bv of the signals u and v, the 
coefficients a and b may be complex. Since in general we assume that the signals 
are complex, we will also allow complex numbers a and b in (1.4). 

Let L be the continuous-time system described by equation (1.1). In order to show 
that the system is linear, we simply have to use the fact that integration is a linear 
operation. The proof then proceeds as follows: 

1 ft 

au(t) + bv(t) i-^- — / e~^~ r ^ R ^ L (au(r) + bv(r)) dr 

L J—o o 

= -(' e-^ R ' L u(r)dT + - T 
Lj-oo L ]_ 00 

= a(Lu)(t) + 7>(Lv)(f). 

◄ 


For a discrete-time system L, the response y[/z] to an input u\n] is given by 


yin ] = 


u[n] + 2 u[n — 1] + u[n — 2] 
4 


for n e 2 j. 



DEFINITION 1.2 

Time-invariant system 


EXAMPLE 1.3 


EXAMPLE 1.4 


Linear time-invariant system 


THEOREM 1.1 


1 Signals and systems 


The output at time n is apparently a weighted average of the input u\n \ at times n, 
n — 1, n — 2. We verify the linearity of this system as follows: 

au[n] + bv[n] H» 

au\n] + bv[n] + 2au[n — 1] + 2 bv[n — 1] + au[n — 2] + bv[n — 2] 

4 

a(u[n] + 2 u[n — 1] + u[n — 2]) i b(v[ri\ + 2v[n — 1] + v[n — 2]) 

“ 4 1 4 

= a(~Lu)[n] + ft(Lv)[/;]. 

◄ 

The second property, the so-called time-invariance, has to do with the behaviour 
of a system with respect to time-delays, or, more generally, shifts in the variable t 
or n. When a system has the property that a time-shift in the input results in the 
same time-shift in the output, then the system is called time-invariant. A precise 
description is given in the following definition. 

A continuous-time system is called time-invariant if for each input u(t) and each 
tg e R one has: 

if u(t ) y(t ) then u(t — to) y(t — to)- (1-5) 

A discrete-time system is called time-invariant if for each input u [/?] and each e Z 

one has: 

if ;/[/?] y[n\ then u[n — ng] y[n — Mg]. (1-6) 

Once again we consider the continuous-time system described by (1.1). This is a 
time-invariant system, which can be verified as follows: 

1 

u(t — to) i-^ — / e~^~ T ^ R ^ L u(r — to) dr 
L J—oo 

= e- (t ~ t0 S )RIL u(M)dl; = y(t - to). 

L J—oo 

In this calculation a new integration variable f = r — to was introduced. ^ 

Again consider the discrete-time system given in example 1.2. This system is time- 
invariant as well. This immediately follows from condition (1.6): 

u[n — no] + 2u[n — 1 — no] + u[n — 2 — no] 
u[n - no] - - - = y[n - n 0 ]. 

4 ◄ 

A system which is both linear and time-invariant is called a linear time-invariant 
system. It is precisely these linear time-invariant systems for which the Fourier 
and Laplace transforms form a very attractive tool. These systems have the nice 
property that the response to a time-harmonic signal, whenever this response exists , 
is again a time-harmonic signal with the same frequency. However, the existence 
of the response to a time-harmonic signal is not ensured. This has to do with the 
eigenfrequencies and the stability of the system. We will discuss the role of stability 
following our next theorem. Treatment of eigenfrequencies will be postponed until 
chapter 5. 

Let L be a linear time-invariant system and u a time-harmonic input with frequency 
a> e R for which the response exists. Then the output y is also a time-harmonic 
signal with the same frequency a>. 
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System function 
Transfer function 


Amplitude response 
Phase response 

EXAMPLE 1.5 


Proof 

We will only prove the case of a continuous-time system. The proof for a discrete¬ 
time system can be given analogously. Let u(t) be a time-harmonic input with 
frequency in and let y(t) be the corresponding output. Hence, u(t ) = ce lmt , where 
c is a complex constant and in e R. The system is time-invariant and so one has for 
each tel: 

ce i<0(t - r) y(t - r). 

On the other hand one has that 

u(t - r) = ce im(, - r) = ce- Uoz e iw ’ = e~ imz u(t). 

Because of the linearity of the system, the response to u(t — t) is then also equal to 
e~ ,a>z y(t). We conclude that for each t e K and ret one has 

y(t - r) = e~ ian y(f). 

Substitution of t = 0, and then replacing —r by t, leads to y(t) — y(0)e la>t , so y(t) 
is again a time-harmonic signal with frequency m. g 

From the preceding proof it follows that the response y(t) to the input u(t) — e ,a>t 
equals Ce uot for some complex constant C, which can still depend on in, meaning 
that C is a function of in. We call this function the frequency response of the system. 
Often one also uses the term system function or transfer function. For continuous¬ 
time systems the frequency response will be denoted by H {in) and for discrete-time 
systems by H(e la> ). The reason for the different notation in the discrete case will 
not be explained until chapter 19. 

The frequency response of a linear time-invariant system is thus defined by the 
following relations: 

e Uot ^ H{in)e imt (1.7) 

for a continuous-time system and 

e icon H{e Uo )e icon (1.8) 

for a discrete-time system. The frequency response H(in ) is complex and so can be 
written in the form 

H{m) = | H{m)\ e io(eo \ 

Here | H(in) | and 4>(a>) are, respectively, the modulus and the argument of H{in). 
The function | H (in) \ is called the amplitude response and $ (in) the phase response. 

Once more we consider the system described by (1.1), which originated from the 
RL-network of figure 1.1. The response y(t) to the input u(t) = e lcot equals 

y(t) = j f' e- {t ~ z)R/L e ia>z dr = i- J™ e SR/L e iaHt-$) ^ 

= ( 7 ; f™ e-^ R/L e~ ia> ^ d^je i(ot . 
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EXAMPLE 1.6 


Bounded signal 


DEFINITION 1.3 

Stable system 


Real system 


This expression already shows that the response is again a time-harmonic signal 
with the same frequency to. The frequency response in this example equals 

H(m) = - / e~^ R/L e~ U0 ^ d% . 

L Jo 

In chapter 6 we will learn how to calculate this kind of integral. This is because we 
are already dealing here with a Fourier transform. The result is: 


H(co) = 


1 

R + icoL 


◄ 


We consider the discrete-time system given in example 1.2, and calculate the re¬ 
sponse y[n ] to the input u\n\ = e' mn as follows: 


y[«] = 


e iam _|_ 2 gi<y(w—1) _|_ e ico(n— 2) ^icon^y _|_ 2e~^ co + e~^ a> ) 


4 4 

Again we see that the response is a time-harmonic signal. Apparently the frequency 
response equals 


H(e no ) = 


(1 + 2e~ ico + e~ 2i( °) 


1.3.3 Stable systems 


Prior to theorem 1.1 we observed that the response to a time-harmonic signal doesn't 
always exist. For so-called stable systems, however, the response exists for all fre¬ 
quencies, and so the frequency response is defined for each to. In order to describe 

what will be meant by a stable system, we first give the definition of a bounded 

signal. 

A continuous-time signal /(f), or a discrete-time signal f[n\ respectively, is called 
bounded if there exists a positive constant K such that 

I /(f) I < K for f e R (continuous-time), 

I /[«] | < K for n e N (discrete-time). 

The definition of a stable system is now as follows. 

A system L is called stable if the response to each bounded signal is again bounded. 

A time-harmonic signal is an example of a bounded signal, since 
| ce uot I = | c | | e uot | = | c | for f e R. 

Hence, for a stable system the response to the input ce ,a>1 exists and this response is 
bounded too. 

1.3.4 Real systems 

In our description of a system we assumed that the inputs and outputs are complex. 
In principle it is then possible that a real input leads to a complex output. A system 
is called real if the response to every real input is again real. Systems occurring in 
practice are mostly real. 

If we apply a complex input u to a real linear system, so u = u\ + iu 2 with u\ 
and u 2 real signals, then, by the linearity property, the response y will equal y \ + iy 2 
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where _V| is the response to u\ and yi the response to ui. Since the system is real, 
the signals yq and yj are also real. For real linear systems one thus has the following 
property. 

The response to the real part of an input u is equal to the real part of the output y 
and the response to the imaginary part of u is equal to the imaginary part of y. 

One can use this property of real systems to calculate the response to a sinusoidal 
signal in a clever way in the case when the frequency response is known. For the 
continuous-time case this can be done as follows. 

Let u(t) be the given sinusoidal input u(t) — Acos(a>t + (pg). Using Euler’s 
formula we can consider the signal u (f) as the real part of the time-harmonic signal 
ce ia>t with c = Ae'^°. According to the definition of the frequency response, the 
response to this signal equals cH(co)e ,C0t . The system being real, this implies that 
the response to the sinusoidal signal u(t) is equal to the real part of cH(a>)e la>r . In 
order to calculate this real part, we write H(a>) in the form 

H{a>) = \H{a))\e i ^ ((o) , 

where | H(co) | is the modulus of H(a>) and 4>(&)) the argument. For the response 
y(t) to the input u(t) we then find that 

y(t) = Re(Ae‘^° | H(co) | e ^M e ia> t) = A | | cos(wf + <p Q + 4>(cn)). 

For real systems and real signals one can thus benefit from working with complex 
numbers. The response y(t) is again a sinusoidal signal with amplitude A \ H(a >) | 
and initial phase <j>g + 4>(o>). The amplitude is multiplied by the factor | H (a>) | and 
one has a phase-shift <t>(a>). On the basis of these properties it is clear why | H(a>) \ 
is called the amplitude response and 4 >(a>) the phase response of the system. 


DEFINITION 1.4 

Causal system 


THEOREM 1.2 


1.3.5 Causal systems 

A system for which the response to an input at any given time tg only depends on 
the input at times prior to tg, hence, only on the ‘past’ of the input, is called a causal 
system. A precise formulation is as follows. 

A continuous-time system L is called causal if for each two inputs u(t ) and v(t) and 
for each tg e R one has: 

ifu(t) = v{t)fort < tg, then (L u)(t) = (Lv)(t) for t < tg. (1.9) 

A discrete-time system L is called causal if for each two inputs u[n\ and v[n\ and 
for each e Z one has: 

ifu[n] = v[n]forn < ng, then (Lz<)[n] = (L v)[n\forn < ng. (L10) 

Systems occurring in practice are mostly causal. The notion of causality can be 
simplified for linear time-invariant systems, since the following theorem holds for 
linear time-invariant systems. 

A linear time-invariant system L is causal if and only if the response to each causal 
input is again causal. 

Proof 

Once again we confine ourselves to the case of continuous-time systems, since the 
proof for discrete-time systems is almost exactly the same and there are only some 
differences in notation. 
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EXAMPLE 1.7 


EXAMPLE 1.8 


Assume that the system L is causal and let u(t) be a causal input. This means that 
u(t ) = 0 for t < 0, so u(t) equals the null-signal for t < 0. Since for linear systems 
the response to the null-signal is again the null-signal, it follows from (1.9) that the 
response y(t) to u(t) has to agree with the null-signal for t < 0 , which means that 
y(t) is causal. 

Next assume that the response to each causal input is again a causal signal. Let 
u(t) and v(f) be two inputs for which u(t ) = v(f) for t < to- Now introduce 
w(t) = u(t + ?o) — v(t + tQ). Then the signal w(f), and so the response (Lw)(f) as 
well, is causal. Since the system is linear and time-invariant, one has that (Lw)(f) = 
(Li/)(f + t ()) — (Lv)(f + to). Hence, (L u)(t + to) = (Lv)(f + fp) for t < 0, that is, 
(Li/)(f) = (Lv)(f) for t < to . This finishes the proof. g 

The linear time-invariant system described by (1.1) is causal. If we substitute a 
causal input u(t) in (1.1), then for t < 0 the integrand equals 0 on the interval of 
integration (—oo, f], and so the integral also equals 0 for t < 0 . ^ 

The discrete-time system introduced in example 1.2 is causal. We have seen that 
the system is linear and time-invariant. Substitution of a causal signal u\n\ in the 
relation 

u\n \ + 2 u[n — 1 ] + u[n — 2 ] 

yw =- 4 - 

leads for n < 0 to the value y[n] = 0. So the response is causal and hence the 
system is causal. ^ 


1.3.6 Systems described by differential equations 

For an important class of linear time-invariant continuous-time systems, the relation 
between the input u(t) and the output y(t) is described by a differential equation of 
the form 

</"' y <•/"' ' 1 y dy 

Clin - “1“ &ni — 1-r “h • • • “h Cl] - Cloy 

dt m 1 dt m ~ l dt U - 

d n u d n ~ 1 u du 

=b "^ +b "- [ ^ + --- +bl ^ +b ° u - 

For example, in electrical networks one can derive these differential equations from 
the so-called Kirchhoff laws. The differential equation above is called a linear differ¬ 
ential equation with constant coefficients, and for these there exist general solution 
methods. In this chapter we will not pursue these matters any further. In chapters 5, 
10 and 14, systems described by differential equations will be treated in more detail. 


1.3.7 Systems described by difference equations 

For the linear time-invariant discrete-time case, the role of differential equations is 
taken over by the so-called difference equations of the type 

boy[n\ + biy[n - 1 ] -I-h byry[n - M] 

= aou[n ] + a\u[n — 1] + • • • + ay/[n — N]. 

This equation for the input u[n\ and the output y[n] is called a linear difference 
equation with constant coefficients. The systems described by difference equations 
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Cascade system 


are of major importance for the practical realization of systems. These will be dis¬ 
cussed in detail in chapter 19. 

EXERCISES 

1.9 For a continuous-time system the response y (t) to an input u(t ) is given by 

y(t) = / u{z)dr. 

Jt -1 

a Show that the system is real, 
b Show that the system is stable, 
c Show that the system is linear time-invariant, 
d Calculate the response to the input u(t) — cos cot. 
e Calculate the response to the input u(t) — sin cot. 
f Calculate the amplitude response of the system, 
g Calculate the frequency response of the system. 

1.10 For a discrete-time system the response y[n] to an input u[n \ is given by 

y\n\ = u[n — 1] — 2 u[n] + u[n + lj. 

a Show that the system is linear time-invariant, 
b Is the system causal? Justify your answer, 
c Is the system stable? Justify your answer, 
d Calculate the frequency response of the system. 

1.11 Two linear time-invariant continuous-time systems Iq and L 2 are given with, re¬ 
spectively, frequency response H\{co) and Hjico), amplitude response A[(co) and 
Ajico) and phase response <l>i(a>) and $2 (&>)■ The system L is a cascade connec¬ 
tion of L [ and L 2 as drawn below. 



FIGURE 1.8 

Cascade connection of Iq and L 2 . 

a Determine the frequency response of L. 
b Determine the amplitude response of L. 
c Determine the phase response of L. 

1.12 For a linear time-invariant discrete-time system the frequency response is given by 

H(e i(0 ) = (1 + i)e~ 2io) . 

a Determine the amplitude response of the system, 
b Determine the response to the input u[ri\ = 1 for all n. 
c Determine the response to the input u[n ] = cos con. 
d Determine the response to the input u\n] = cos 2 Icon. 

SUMMARY 

An important field for the applications of the Fourier and Laplace transforms is 
signal and systems theory. In this chapter we therefore introduced a number of 
important concepts relating to signals and systems. 
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1 Signals and systems 


Mathematically speaking, a system can be interpreted as a mapping which assigns 
in a unique way an output y to an input u. What matters here is the relation between 
input and output, not the physical realization of the system. 

Mathematically, a signal is a function defined on R or Z. The function values are 
allowed to be complex numbers. 

In practice, various types of signal occur. Hence, the signals in this book were 
subdivided into continuous-time signals, which are defined on R, and discrete-time 
signals, which are defined on Z. An important class of signals is the periodic sig¬ 
nals. Another subdivision is obtained by differentiating between energy- and power- 
signals. Signals occurring in practice are mostly real-valued. These are called real 
signals. An important real signal is the sinusoidal signal which, for a given fre¬ 
quency a>, initial phase <j>g and amplitude A, can be written as f(t) — A cos(a>f+/o) 
in the continuous-time case and as f[n\ = A cosfcon + <pg) i n the discrete-time case. 
The sinusoidal signals are periodic in the continuous-time case. In general this is 
not true in the discrete-time case. A sinusoidal signal can be considered as the real 
part of a complex signal, the so-called time-harmonic signal ce ,a>t or ce l(on , with 
frequency to and complex constant c. 

Time-harmonic signals play an important role, on the one hand in all of the 
Fourier transforms, and on the other hand in systems that are both linear and time- 
invariant. These are precisely the systems suitable for an analysis using Fourier and 
Laplace transforms, because these linear time-invariant systems have the property 
that time-harmonic input result in outputs which are again time-harmonic with the 
same frequency. For a linear time-invariant system, the relation between a time- 
harmonic input u and the response y can be expressed using the so-called frequency 
response H(a>) or H(e uo ) of the system: 

e lmt H(co)e uot (continuous-time system), 

e ,om i-> H(e ,a> )e lmn (discrete-time system). 

The modulus of the frequency response, H(a >) or H(e uo ) respectively, is called 
the amplitude response, while the argument of the frequency response is called the 
phase response of the system. Of practical importance are furthermore the real, the 
stable and the causal systems. 

Real systems have the property that the response to a real input is again real. The 
response of a sinusoidal signal is then a sinusoidal signal as well, with the same 
frequency. 

Stable systems have the property that bounded inputs result in outputs that are 
also bounded. For these systems the frequency response is well-defined for each to. 

The response of a causal system at a specific time t depends only on the input at 
earlier times, hence only on the ‘past’ of the input. For linear time-invariant systems 
causality means that the response to a causal input is causal too. Here a signal is 
called causal if it is switched on at time fq > 0. 


SELFTEST 

1.13 a Calculate the power of the signal /(f) = A cos cot + B cos(a>f + cj>g). 

b Calculate the energy-content of the signal /(f) given by 

1 0 for t < 0, 

sin(7rf) for 0 < t < 1, 

0 for t > 1. 


1.14 


Show that the power of the time-harmonic signal /(f) = ce ia>t equals | c \~. 
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1.15 


1.16 


1.17 


1.18 


1.19 


a Calculate the power of the signal f[n] = A cos (jtn/A) + B s'm(nn/2). 
b Calculate the energy-content of the signal f[n] given by 


f 0 for n < 0, 

/W= |(1 )" for n > 0. 

For a linear time-invariant continuous-time system the frequency response is given 
by 


e im 


a Calculate the amplitude and phase response of the system, 
b The time-harmonic signal u(t) — ie lt is applied to the system. Calculate the 
response y{t) to u(t). 

For a real linear time-invariant discrete-time system the amplitude response A(e uo ) 
and phase response (Fie"") are given by A(e i( °) = 1/(1 + or) and <J>(e !ttl ) = a> 
respectively. To the system the sinusoidal signal u\n] = sin 2 n is applied, 
a Is the signal u\n] periodic? Justify your answer. 

b Show that the output is also a sinusoidal signal and determine the amplitude and 
initial phase of this signal. 


For a continuous-time system the relation between the input u(t) and the corre¬ 
sponding output y(t) is given by 

y(t) = u(t — to) + / u{T)dr. 

Jt -1 

a For which values of is the system causal? 
b Show that the system is stable, 
c Is the system real? Justify your answer, 
d Calculate the response to the sinusoidal signal u(t) — sin7rt. 


For a discrete-time system the relation between the input u[n] and the corresponding 
output y\n \ is given by 

n 

y \n | = u[n — nq] + «[/]. 

l=n —2 


a For which values of uq e Z is the system causal? 
b Show that the system is stable, 
c Is the system real? Justify your answer, 
d Calculate the response to the input u\n\ = cosjrn. 
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CHAPTER 2 


Mathematical prerequisites 


INTRODUCTION 


In this chapter we present an overview of the necessary basic knowledge that will 
be assumed as mathematical prerequisite in the chapters to follow. It is presupposed 
that the reader already has previous knowledge of the subject matter in this chapter. 
However, it is advisable to read this chapter thoroughly, and not only because one 
may discover, and fill in, possible gaps in mathematical knowledge. This is because 
in Fourier and Laplace transforms one uses the complex numbers quite extensively; 
in general the functions that occur are complex-valued, sequences and series are se¬ 
quences and series of complex numbers or of complex-valued functions, and power 
series are in general complex power series. In introductory courses one usually re¬ 
stricts the treatment of these subjects to real numbers and real functions. This will 
not be the case in the present chapter. Complex numbers will play a prominent role. 

In section 2.1 the principal properties of the complex numbers are discussed, as 
well as the significance of the complex numbers for the zeros of polynomials. In 
section 2.2 partial fraction expansions are treated, which is a technique to convert a 
rational function into a sum of simple fractions. Section 2.3 contains a short treat¬ 
ment of differential and integral calculus for complex-valued functions, that is, func¬ 
tions which are defined on the real numbers, but whose function values may indeed 
be complex numbers. One will find, however, that the differential and integral cal¬ 
culus for complex-valued functions hardly differs from the calculus of real-valued 
functions. In the same section we also introduce the class of piecewise continuous 
functions, and the class of piecewise smooth functions, which are of importance 
later on for the Fourier and Laplace transforms. In section 2.4 general convergence 
properties, and other fundamental properties, of sequences and series of complex 
numbers are considered. Again there will be some similarities with the theory of 
sequences and series of real numbers. Fourier series are series of complex-valued 
functions. Therefore some attention is paid to series of functions in section 2.4.3. 
Finally, we treat the complex power series in section 2.5. These possess almost 
identical properties to real power series. 
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2 Mathematical prerequisites 


Real part 
Imaginary part 


LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- can perform calculations with complex numbers, in cartesian as well as in polar 
and exponential form 

- know that by using complex numbers, a polynomial can be factorized entirely into 
linear factors and that you are able to perform this factorization in simple cases 

- know what is meant by the nth roots of unity 

- know the technique of (complex) partial fraction expansions 

- can apply differential and integral calculus to complex-valued functions 

- know what is meant by a piecewise continuous and a piecewise smooth function 

- can apply the theory of sequences and series to sequences and series with complex 
terms 

- are familiar with the concept of radius of convergence for complex power series 
and can calculate the radius of convergence in simple situations 

- know the properties of the sum of a power series. 


2.1 Complex numbers, polynomials and rational functions 

2.1.1 Elementary properties of complex numbers 

The complex numbers are necessary in order to determine the solutions of all 
quadratic equations. The equation x~ — 2x + 5 = 0 has no solution in the real 
numbers. This is because by completing the square it follows that x 2 — 2x + 5 = 
(x — 1 )~ + 4 > 0 for all real x. If we now introduce the imaginary unit i, which by 
definition satisfies 


and subsequently the complex number x = 1 + 2i, then (x — 1 ) 2 + 4 = (2if + 4 — 
—4 + 4 = 0. Apparently the complex number x — 1 + 2 i is a solution of the 
given equation. Complex numbers are therefore defined as the numbers z that can 
be written as 

z = x + iy with jjel. (2.1) 

The collection of all these numbers is denoted by C. The real number x is called the 
real part of z and denoted by x = Rez. The real number y is called the imaginary 
part of z and denoted by y = Imz. Two complex numbers are equal if the real parts 
and the imaginary parts are equal. For the complex number z one has that z = 0 if 
Re z = 0 and Im z = 0. For the addition and multiplication of two complex numbers 
z = x + iy and w = u + iv one has by definition that 

z + w = (x + iy) + (u + iv) = (x + «) + (' (y + v), 
z ■ w = (x + iy)(u + iv) = {xu — yv) + i(xv + yu). 

For subtraction and division one subsequently finds: 

z — w = (x - u) + i(y - v), 

z x + iy x + iv u — iv xu + yv yu — xv 

— = -- = -- • - = + i -y for w f 0. 

W U + IV U + IV U — IV u- + v z u z + v z 


We see that both sum and product as well as difference and quotient of two complex 
numbers have been written in the form z = Rez + ilmz again. The set C is an 
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Complex conjugate 


Cartesian coordinates 
Complex plane 
Real axis 
Imaginary axis 


Polar coordinates 


Cartesian form 
Polar form 

Modulus 


Unit circle 


extension of R, since a real number x can be written as x = x + 0 ■ i. The complex 
conjugate of a complex number z is defined as 

z ~ x - iy. 

Note that zz — x 2 + y 2 and z. = z. One can easily check that the complex conjugate 
has the following properties: 

z + w =z + w, zw = zw, ( —) = = if w ± 0. 

V w > w 

Using the complex conjugate one can express the real and imaginary part of a com¬ 
plex number as follows: 

7 + 7 7 — 7 

Rez = - and Imz = -. 

2 2 (' 

Since we need two real numbers x and y to describe a complex number z = x + 
iy, one can assign to each complex number a point in the plane with rectangular 
coordinates x and y, as shown in figure 2.1. The coordinates x and y are called 
the cartesian coordinates. Figure 2.1 moreover shows the complex conjugate of z. 
The plane in figure 2.1 is called the complex plane and the axes the real axis and the 
imaginary axis. In this figure we see how the location of z can also be determined 



FIGURE 2.1 

The complex number z and its complex conjugate z. 

by using polar coordinates r and <p. Here r is the distance from z to the origin and f 
is the angle, expressed in radians, between the positive real axis and the vector from 
the origin to z. Since x = r cos f and y = r sin cj> one has that 

z = r(cos<p T i sirup). (2.2) 

Expressing z as in (2.1) is called the cartesian form of z, while expressing it as 
in (2.2) is called the polar form. As we shall see in a moment, multiplication of 
complex numbers is much more convenient in polar form than in cartesian form. 
The number r, the distance from z to the origin, is called the modulus or absolute 
value of z and is denoted by | z |. The complex numbers with | z | = 1 all have 
distance 1 to the origin and so they form a circle with radius 1 and the origin as 
centre. This circle is called the unit circle. The modulus is a generalization of 
the absolute value for real numbers. For the modulus of z = x + iy one has (see 
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2 Mathematical prerequisites 


THEOREM 2.1 
Triangle inequality 


Argument 


THEOREM 2.2 


figure 2.1) r 2 = | z \ 2 = x~ + y 2 , hence r = | z | = V* 2 + y 2 . When z is real, | z | 
coincides with the well-known absolute value of a real number: | z | = | x | = Vx 2 . 
If z = v + ;>• and vv = u + iv, then | z — w \~ = (x — u) 2 + (y — v) 2 . In the complex 
plane | z — w | is thus equal to the distance between the complex numbers z and w. 
Using the definition of modulus it is easy to verify the following properties: 

I z I = I z |, zz = |z[ 2 , ~ = ~^j ifz^O. (2.3) 

Z |z| 2 

An important property of the modulus is the so-called triangle inequality. 

For complex numbers z and w one has 
I z + w | < | z | + | w |. 

Proof 

If z — x + iy, then | z | 2 = x 2 + y 2 > x 2 = \ x | 2 = | Rez | 2 . Hence, | z I > | Rez |. 
In the same way one can show that | z | > | Imz |. With these inequalities we can 
prove the triangle inequality as follows: 

I z + w | 2 = (z + w)(z + W) = zz + (zw + zw ) + ww 

= zz + 2Re(zw) + wW < \ z | 2 + 2 | zw \ + \ w | 2 
= I z | 2 + 2 | z 11 w | + | w | 2 = (| z | + | w |) 2 . 

Hence, |z + w|<|z| + |w|. g 

The angle f in the polar form of a complex number is called the argument of z 
and is denoted by tp = arg z. The argument of z is by no means uniquely determined 
since f + 2kn (k an integer) is also an argument of z. If z is a positive number, then 
argz = 0 + 2kn. If z is a negative number, then argz = n + 2kn. From figure 2.1 
one immediately infers that the property 

argz = - argz 

holds up to an integer multiple of 2 n. It will be agreed upon that all relations 
involving arguments have to be read with the following clause: they hold up to an 
integer multiple of2n. In particular this also holds for the property in the following 
theorem. 

For complex numbers z and w one has 
arg(zw) = argz + arg w. 

Proof 

If z = r(cos (j> + i sin <j>) and w — s (cos i/s + i sin i/f), then we find by a straightfor¬ 
ward multiplication, and using the formulas cos(a' + f) = cos a cos f — sin a sin f 
and sin(a + f>) = sin a cos f) + cosct sin f. that 

ZW = rs (cos 4> cos \[r — sin 0 sin x[r + i (cos 0 sin ijr + sin f cos \[r)) 

— rs(cos(<p + t jr) + i sin(0 + i fr)). 

One thus has that arg(zvv) = f + ’A — ar g z + arg w. g 

In the proof of theorem 2.2 we also see that | zw \ = [ rs \ = | r \ ■ \ s \ = | z | ■ 
| w |. Apparently a multiplication of complex numbers in polar form is simple: the 
arguments have to be added and the moduli multiplied. Similarly one can show that 
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De Moivre’sformula 


DEFINITION 2.1 

Euler’s formula 


Exponential form 


division is easy as well, when using the polar form. We summarize the properties of 
multiplication and division as follows: 

arg(zw) = argz + argw, | zw | = | z | ■ | w |, (2.4) 

arg (—)= argz — argw, I — I = 7 —r for w 7 ^ 0. (2.5) 

\w1 I w I | w I 

From (2.4) it follows that for all integer n, so also for negative n, one has the so- 
called De Moivre's formula: 

(cos fi + i sin fi) n — cos nfi + i sin nfi for <j> e R. 

Since multiplication of complex numbers means adding arguments, it is quite natural 
to use an exponential notation for the argument. For this we use Euler’s formula. 

For each <f> e R the complex number e’ < t > is defined as 

e‘^ — cost/) + i sin(/>. 

For z = x + iy one defines e z by 

e z = e x e iy = e x (cos y + i sin v). ( 2 . 6 ) 

One can easily check that | e‘^ | = 1 and arg(e'^) = cj> for all fie 1. Hence e'^ 
lies on the unit circle for each fie R. Furthermore we have 

Re(e’) = e x cosy, Im(e z ) = e x siny, 
arg(e z ) = Imz, I | = e x = e Rez . 

Since each complex number z can be written as z = r(cos fi + i sin fi) with r = | z |, 
one can also write z in the so-called exponential form 

z = re'^ = \z\e'^. 

Analogous to the proof of theorem 2.2 it now follows for fi, fi e R that 

e ifi e ‘fi — (cos.fi + ismfi)(cosfi + is'mfi) 

= cos (fi + fi) + i sin (fi + 1 jr) = e ! ( < H- , / r ). (2.7) 

The product of two complex numbers can now be written as 
zw = | z I | w | e^ = | z 11 w | 

We close this subsection with a list of frequently used properties involving the ex¬ 


ponential form: 

| e i(t> | = 1 for fi e R, (2.8) 

cos.fi = Re(e'^), sinfi = \m(e'^), (2.9) 

e ifi = e -ifi : (2.10) 

gifi _|_ e -i<l> g'fi — g-'fi 

cos fi = - and sin fi = -, (2.11) 

2 2 i 

e 2nik = \ for k eZ, (2.12) 

e i(fi+2k7t) = e ifi for k € (2.13) 

(gifi\ k = e ikfi for k e Z. (2.14) 
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2 Mathematical prerequisites 


Root 

Polynomial 

Zero 


Multiplicity 


EXAMPLE 2.1 


Simple zero 


2.1.2 Zeros of polynomials 

We know that quadratic equations do not always admit real solutions. A quadratic 
equation is an example of an equation of the more general type 

anZ + a n -\z + ■ ■ ■ 4- a\z 4- oq = 0 (2.15) 

in the unknown z, where we assume that the coefficients oq, a \,.... a n may be 
complex with a„ 0. In this subsection we will pay special attention to the solu¬ 
tions or the roots of this equation. The left-hand side will be denoted by P(z). so 
P(z) = a„z n + iz ” -1 + • • • + a\z + flo- and is called a polynomial of degree 

n. Hence, solving equation (2.15) means determining the zeros of a polynomial. 
Using algebra, one can show that if z = a is a zero of P(z) (where a may also be 
complex), then the polynomial P{z) can be written as P(z) = (z — a)Qi(z) for 
some polynomial Qi(z). We then say that the linear factor z — a divides P(z). If 
Q\(a) = 0 as well, then we can write P(z) as P(z) = (z — a)~Q 2 (z ). Of course, 
we can continue in this way if £> 2 ( 0 ) = 0 as well. Ultimately, this leads to the 
following statement. 

If z = a is a zero of a polynomial P(z). then there exists a positive integer v such 
that 

P( z ) = (z-a) v Q(z) 

for some polynomial Q(z) with Q(a ) 7 ^ 0. The number v is called the multiplicity 
of the zero a. 

Let P(z) be the polynomial of degree four given by 
P(z) = z 4 -2z 3 + 5z 2 -Sz + 4. 

Now z — 1 is a zero of P(z). This implies that we can divide by the factor z — 1, 
which results in P{z) = (z — l)(z 3 — z 2 + 4z — 4). However, z = 1 is also a zero 
of z 3 — z 2 + 4z — 4. Again dividing by z — 1 results in P(z) = (z — 1 ) 2 (z 2 + 4). 
Since z = 1 is no longer a zero of z 2 + 4, z = 1 is a zero of P(z) of multiplicity 2. 
We also note that z = 2 i and z = — 2i are zeros of P(z). Factorizing z 2 + 4 gives 

P(z) = (z- l) 2 (z-2i)(z + 2i). 

The polynomial has a zero z = 1 of multiplicity 2 and zeros z = 2; and z = —2 i of 
multiplicity 1 . ^ 

Zeros of multiplicity 1 are also called simple zeros. In the preceding example we 
saw that in the complex plane the polynomial P (z) is factorized entirely into linear 
factors. This is a major advantage of the introduction of complex numbers. The fact 
is that any arbitrary polynomial can be factorized entirely into linear factors. This 
statement is based on the so-called fundamental theorem of algebra, which states 
that (2.15) always has a solution in C. The treatment of the fundamental theorem of 
algebra falls outside the scope of this book. We thus have the following important 
property: 

Let P(z) = a n z n + a„_ iz n ~ l + • • • + a\z + oq be a polynomial of degree n. Then 
P(z) can be written as 

P(z) = a n (z - zi) yi ■ ■ ■ (z - z k ) Vk . (2.16) 

Here zi, •••, z k are the distinct zeros of P(z) in C with their respective multi¬ 
plicities. 
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EXAMPLE 2.2 


nth roots of unity 


From (2.16) we can immediately conclude that the degree of P(z) equals the sum of 
the multiplicities. If we count the number of zeros of a polynomial, with each zero 
counted according to its multiplicity, then it follows that a polynomial of degree n 
has precisely n zeros. 

When in particular the coefficients of P(z) are real, then 
P(z) = a n z n + a n _fz n ~ X -\ -h afz + a 0 = P(z). 

Hence, if P(a) = 0, then P(d) = 0 as well. Now if a is a non-real zero, that is if 
a =f~d, then 

Pfz) = (z - a)(z-d)Q(z) = (z 2 - {a+ a)z +ad)Q(z) 

= (z 2 - (2R ea)z + | a | 2 ) Q(z). 

Apparently the polynomial P(z) contains a quadratic factor with real coefficients 
z 2 — (2Re a)z+ I a I 2 , which cannot be factorized any further into real linear factors. 
As a consequence we have: 

A polynomial with real coefficients can always be factorized into factors which are 
linear or quadratic and having real coefficients. The zeros are real or they occur in 
pairs of complex conjugates. 

The polynomial z 4 + 4 is a polynomial with real coefficients. The complex zeros are 
(see exercise 2.6a): 1 + i , 1 — i, — (1 + 0, — (1 — i). So z 4 + 4 = (z — 1 — i)(z — 1 + 

i)(z + 1 + i)(z + 1 — /)■ Since (z - 1 - i)(z - 1 + i) = (z - l) 2 + 1 = z 2 - 2z + 2 

and (z + 1 + f)(z + 1 — 0 = (z + l) 2 + 1 = z 2 + 2 z + 2, one has that 

z 4 + 4 = (z 2 - 2z + 2)(z 2 + 2z + 2). 

This factorizes the polynomial z 4 + 4 into two factors with real coefficients, which 
can still be factorized into linear factors, but then these will no longer have real 
coefficients. ^ 

In the theory of the discrete Fourier transform, an important role is played by the 
roots of the equation 


These roots are called the nth roots of unity. We know that the number of zeros of 
z" — 1 is equal to n. First we determine the moduli of the zeros. Front (2.4) follows 
that I z” | = | z |" and since z n = 1, we obtain that | z | = 1. From this we conclude 
that all solutions lie on the unit circle. The arguments of the solutions can be found 
as follows: 

n arg z = arg(z") = arg 1 = 2 Ictz. 

Dividing by n leads to argz = 2kn/n. For k = 0, 1, .... n — 1 this gives n distinct 
solutions. The nth roots of unity are thus 

Z£ = e ,2 W" — cos _j_ ■ s j n ^ for k = 0, 1.n — 1. 

These solutions are drawn in figure 2.2 for the case n = 5. Note that the roots 
display a symmetry with respect to the real axis. This is a consequence of the fact 
that the polynomial z” — 1 has real coefficients and that thus the complex conjugate 
of a zero is a zero as well. 

The method described for solving the equation z” = 1 can be extended to equa¬ 
tions of the type z” = a. where a is an arbitrary complex number. We will illustrate 
this using the following example. 
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2 Mathematical prerequisites 


EXAMPLE 2.3 


EXAMPLE 2.4 



FIGURE 2.2 

The solutions of z 5 = 1. 


We determine the roots of the equation z 3 = 8 i. First we note that | z | 3 = | z 3 | = 
| Si | = 8 . From this it follows that | z | = 2, so the roots will lie on a circle with 
radius 2. For the argument one has: 3 arg z = arg(z 3 ) = arg(80 = n/2 + 2k.it. So 
argz = it /6 + 2kn/3 (k = 0,1, 2). Hence, the roots are 

Zk = 2 e ! ( 7 r '' , 6 + 2 * 7r / 3 > — 2 ^cos ^gjr + jkn^j + i sin ^ir + ^kit^j , 

for k = 0, 1, 2. See figure 2.3. ^ 



FIGURE 2.3 

The solutions of z 3 = 8 i. 


By completing the square one can reduce a quadratic equation to an equation of 
the type z 2 = a, which can subsequently be solved using the method above. To that 
end we consider the following example. 

Let the quadratic equation z 2 + 2 iz — 1 + i = 0 be given. Completing the square 
leads to (z + ()“ + / = 0. Put w = z + i. Then w satisfies the equation w 2 = —i. 
Hence, |w 2 | = 1, implying that | w \ = 1. For the argument one has: 2argw = 
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arg (w~) — arg(— i) = 2>n/2 + 2kn. From this it follows that argw = 37r/4 + kn 
(k = 0, 1). We find the two roots w\ — cos ( 3 jt / 4 ) + i sin(3?r/4) = (—14- i)/s/2 
and w 2 = —w\ and subsequently the two roots zi and Z 2 we were looking for: 

Zl = w\—i = -^V2 4- i(^</2— 1), 

z 2 = W 2 - i = \js/2 — if-s/2+ 1 ). 

2 ◄ 

EXERCISES 

2.1 a Determine argument and modulus of z — — 1 4- i, z = 2 i, z = — 3 and z = 

-1 - iV3. 

b Write z = 2 4- 2i, z = — \/3 4- f and z = —3/ in exponential form. 

2.2 Prove that for all complex z and w one has: 

|z±w|>||z|-|w||. 

2.3 Prove the properties (2.8) up to (2.14). 

2.4 Let the complex numbers zi = 4 — 4 i and z 2 = —2 4- 2/a/ 3 be given. Give the 
exponential form of z\/z 2 , and z\/z\. 

2.5 Draw in each of the following cases the set of complex numbers z in the complex 
plane satisfying: 

a 0 < | z | < 3, 
b | z | < 2, 
c 4 < | z I < 5, 
d | z - (1 4- 2() | < 3/2, 
e Rez < 3, 

f | Re z I < 2, 

g Rez > 2 ^ and | z — 2 [ < 1. 

2.6 Solve the following equations: 
a z 4 4- 4 = 0, 

b z 6 + 1 = is/ 3, 
c 5z 2 + 2z + 10 = 0. 

2.7 Give a factorization of the polynomial z‘ — z 4 4- z — 1 into linear factors only, 
and also into factors with real coefficients only and which cannot be factorized any 
further into factors with real coefficients. 

2.8 Determine the solutions z of the equation e z = 2i. 


2.2 Partial fraction expansions 

The partial fraction expansion of rational functions is a technique which is used to 
determine a primitive of a rational function. In the chapters on the Laplace transform 
and the z-transform we shall see that the same technique can be used to determine 
the inverse transform of a rational function. The technique will be explained in the 
present section. 

A rational function F(z) is a function which can be written in the following form: 

_ Q„z” 4- a n -iz n ~ l -\ -h a\Z 4- ap 

b m z m 4- b m _ l z m ~ l 4 -h biz + b Q 


(2.17) 



36 


2 Mathematical prerequisites 


Pole 


Order of pole 


EXAMPLE 2.5 


The numerator and denominator consist of polynomials in the complex variable z. 
Denote the numerator by P(z) and the denominator by Q(z)- We assume that b m 
0 and a n 0. The degree of the numerator is n and the degree of the denominator 
is m. The zeros of Q(z ) are called the poles of F(z). In section 2.1.2 we noted that, 
as a consequence of the fundamental theorem of algebra, in the complex plane each 
polynomial can be factorized entirely into linear factors. The denominator Q(z ) can 
thus be written as 


Q(z) = b m (z - zi) vi (z - Z2) V1 ■ ■ ■ (z - Zk) Vk , 

where z\, Z 2 , ■ ■ ■, Zk are the distinct zeros of Q(z)- The point zj is then called a 
pole of order v: of F(z)- 

Before starting with a partial fraction expansion, one should first check whether 
or not the degree of the numerator is smaller than the degree of the denominator. If 
this is not the case, then we first divide by the denominator, that is, we determine 
polynomials D(z) and R(z) such that P(z) = D(z)Q(z ) + R(z), where the degree 
of R(z) is smaller than the degree of the denominator Q{z)- As a consequence, F(z) 
can be written as 


F(z) = D{z) + 


R(z) 

Q(z) 


The rational function R(z)lQ{z) in the right-hand side now does have the property 
that the degree of the numerator is smaller than the degree of the denominator. We 
shall illustrate this using an example. 


The rational function F(z) is given by 


F(z) = 


z 4 + 1 
z 2 - 1 


The degree of the numerator is greater than the degree of the denominator. We 
therefore perform the following long division: 


z 2 - 1 / z 4 + 1 \ z 2 + 1 

4 2 

-7^ - ’7*' 


z 2 +1 
z 2 -1 


2 

From this it follows that z 4 + 1 = (z 2 + l)(z 2 — 1) + 2 and hence 

F(z) = z 2 + 1 -I — 

Z 1 

Henceforth we will assume that we are dealing with a rational function F(z ) as 
given by (2.17) but with the additional condition that n < m. The purpose of a 
partial fraction expansion is then to write this rational function as a sum of fractions 
with the numerators being (complex) constants and the denominators z — zi, z — Z2, 
z — Zk- If the order vj of a pole is greater than 1, then denominators (z — Zj) 2 , 
(z — z j) 3 , ..., (z — Zj) v i also occur. If the coefficients of Q(z.) are real, then Q(z) 
can be written as a product of linear and quadratic factors with real coefficients, 
and F(z) can then be expanded into fractions with (powers of) linear and quadratic 
denominators with real coefficients. For the quadratic denominators, the numerators 
may be linear. 
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EXAMPLE 2.6 


EXAMPLE 2.7 


The first step in the technique of the partial fraction expansion consists of a factor¬ 
ization of the denominator Q(z). This means determining the zeros of Q(z) together 
with their multiplicities. Next, the actual partial fraction expansion takes place. The 
following two examples will show how partial fraction expansions are carried out in 
the case where Q(z) is factorized entirely into linear factors. 


Let the rational function be given by 


F(z) = -4—-. 

(z - l) 2 (z 2 + 1) 

The denominator Q{z ) can be factorized into linear factors as follows: Q(z ) = 
(z — l) 2 (z — ;)(z + i). There is a zero z = 1 with multiplicity 2 and there are 
simple zeros for z = ±t. A partial fraction expansion is aimed at writing F(z) in 
the following form: 


F(z) = 



B 

4--1 

(z - l) 2 



D 

+ -. 

z + i 


Here A, B, C and D are constants, still to be determined. Note that the zero of 
multiplicity 2 has two fractions linked to it, while the simple zeros have only one. 
The constants can be calculated as follows. Multiplying the expansion above by the 
denominator Q (z) gives the identity 

z = A(z - l)(z 2 + 1) + 6(z 2 + 1) + C(z - l) 2 (z + 0 + D(z - l) 2 (z - 0 (2.18) 


Formally one should exclude the zeros of Q(z) in this identity, since these are the 
poles of F(z). However, the right-hand and left-hand sides contain polynomials and 
by a limit transition one can prove that for these values of z the identity remains 
valid. Substituting the zeros z = 1, z = i and z = —i of Q{z) in (2.18) gives the 
following results: 

1 = 25, i = AC, -i = AD. 


We still lack one equation. To find it, we use yet another property of polynomials. 
Namely, two polynomials in z are equal if and only if the coefficients of correspond¬ 
ing powers are equal. Comparing the coefficients of z 3 in both sides of equation 
(2.18) establishes that 


0 = A + C + O. 


From the preceding equations it follows easily that A — 0, 5 = 1/2, C = i I A, 
D = —i/A. Ultimately, the partial fraction expansion is as follows: 


F(z) = 


1/2 


i/A i/A 


1 


(z — l) 2 z — i z + i 2(z - l) 2 4(z - i ) 4(z + i)' 


◄ 


Let the function F(z) be given by 


F(z) = 


z 

6 iz — 8 


We factorize the denominator Q(z) by first completing the square: Q(z) = (z — 
30 2 + 1 = (z — 3t — t)(z — 3 i + i) = (z — 4/)(z — 2 i). There are simple zeros at 
z = Ai and at z = 2 i. The rational function can then be expanded as follows: 


F(z) = 


A 6 

z — Ai z — 2 i 
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EXAMPLE 2.8 


EXAMPLE 2.9 


The constants A and B can be found by first multiplying by the denominator and 
then substituting its zeros. It then follows that A = 2 and B = — 1. The partial 
fraction expansion is as follows: 


F(z) = 


z — 4i z — 2 i 


For some applications it is more convenient to obtain, starting from a rational 
function with real coefficients in the numerator as well as in the denominator, a par¬ 
tial fraction expansion where only fractions having real coefficients occur as well. 
When all zeros of the denominator Q(z) are real, this is no problem; the partial frac¬ 
tion expansion can then be performed as in the previous examples. If, however, Q (z) 
has also non-real zeros, then linear factors will no longer suffice. In a real factoriza¬ 
tion of Q(z), quadratic factors will then appear as well. In the following examples 
we will show how in these circumstances one can determine a real expansion. 

Let the function F(z) from example 2.6 be given: 


F(z) = 


(z — l) 2 (z 2 T 1)' 


The denominator contains a quadratic factor having no factorization into linear fac¬ 
tors with real coefficients. With this factor we associate a fraction of the form 
Az + B 


with real coefficients A and B. The partial fraction expansion now looks like this: 

z A B Cz + D 

(z-l) 2 (z 2 + l) z—1 (z — l) 2 z 2 + 1 
Multiplying by the denominator of F(z) leads to the following identity: 
z = A(z - l)(z 2 + 1) + B(z 2 + 1) + (Cz + D)(z - l) 2 . 

Substitution of z = 1 gives B = 1/2. Next we equate coefficients of corresponding 
powers of z. For the coefficient of z , z 2 and z it subsequently follows that 


0 = A + C, 


0 = -A + B - 2C + D, 


1 = A + C-2D. 


The solution to this system of equations is A = 0, B = 1/2, C = 0, D = —1/2 and 
so the real partial fraction expansion looks like this: 

z _ 1/2 _ 1/2 _ __1_ 1 

(z — 1 ) 2 (z 2 T 1) “ (z — l) 2 Z 2 + 1 “ 2(z- l) 2 ~~ 2(z 2 + T)' 


We finish with an example where a quadratic factor occurs twice in the denomi¬ 
nator of F(z). 

Let the function F(z) be given by 


F(z) = 


z + 3z + 3 
(z 2 + 2z + 4) 2 ' 


The quadratic factor in the denominator cannot be factorized into linear factors with 
real coefficients. Since the quadratic factor occurs twice, the partial fraction expan¬ 
sion has the following form: 


z 2 T 3z T 3 


Az + B 


Cz + D 


(z 2 + 2 z + 4) 2 z 2 + 2z + 4 (z 2 + 2z + 4) 2 
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2.9 


2.10 


2.11 


2.12 


Complex-valued function 


Multiplying by the denominator of F(z) gives 
z 2 + 3z + 3 = (Az + S)(z 2 + 2z + 4) + (Cz + D). 

Equating the coefficients of z , z , z 2 and z 3 gives, respectively, 

3 = 4 B + D, 3 = 4A + 2B + C, 1 = 2 A + B, 0 = A. 


The solution to this system is A = 0, B = 1, C = 1 , D = —1. The partial fraction 
expansion is then as follows: 


z 2 T 3z T 3 _ 1 z - 1 

(z 2 + 2z + 4) 2 z 2 + 2z + 4 (z 2 + 2z + 4) 2 


EXERCISES 

Determine the partial fraction expansion of F(z) given by 

z 


F(z) = 


(z - 1/2) (z - 2) 


Determine the partial fraction expansion, into fractions with linear denominators, of 
the function F(z) given by 


F{z) = 


1 


z 2 + 4z + 8 


Determine the partial fraction expansion of the function F(z) given by 
a F(z) = 


(zT 1) 2 (zT3)’ 


b F(z) = 


z 2 + l 
(z+1) 3 ' 


Determine the partial fraction expansion, into fractions with denominators having 
real coefficients, of the function F(z) given by 


F(z) = 


2z 2 -5z+ll 
z 3 — 3z 2 + 7z — 5 


2.3 Complex-valued functions 

In general, the functions in this book are prescriptions associating a complex number 
with each real variable t from the domain. We call this a complex-valued function. 
An important example is the function fit) = e uot , where to is a real constant. This 
function is called a time-harmonic signal with frequency a> (see chapter 1). Note 
that according to definition 2.1 one has that e lwt = cos cot + i sinatf. 

A complex-valued function can be written as 

f(t) = u(t) + iv(t), 

where u and v are real-valued functions of the real argument t. Analogous to com¬ 
plex numbers, we use the concepts real and imaginary part of fit): 


u (t) = Re fit), 


v(0 = Im fit). 
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-1 


DEFINITION 2.2 

Limit of a complex-valued 
function 


THEOREM 2.3 




FIGURE 2.4 

Range of the functions e ,7rl and e lnt jt. 


A complex-valued function can be represented as a graph by drawing its range in 
the complex plane. This range is a curve in the complex plane having parametric 
representation (u(t), v(f)). For the functions e l7Tt and e l7lt /t (a part of) the range is 
shown in figure 2.4. 

For complex-valued functions the notion of a limit can simply be defined by 
starting from limits of real-valued functions. We utilize the following definition. 

Let L be a complex number and f(t) a complex-valued function with real part u(t) 
and imaginary part v (t). Then 

lim f(t) = L if and only if lim u(t) = Re L and lim v(f) = Im L. 

t—>a t^a t^a 

A consequence of this definition is the following theorem. 

Let L be a complex number and fit) a complex-valued function. Then 
lim /(f) = L if and only iflim t - i . a \ f(t) — L | = 0. 

Proof 

We first prove that lim t ^. a f(t) = L implies that lim f _>. a | /(f) — L | = 0. If 
lim t^-a f{t) = L, then by definition limr->. a u(t) = ReL and linv-^a v(f) = ImL 
and hence 

lim | /(f) - L | = lim J(u(t) - Re L) 2 + (v(f) - Im L) 2 = VO + 0 = 0. 

Next we prove that \ f(t) — L \ = 0 implies that lim r _>. a /(f) = L. One 

has that: 

| u(t) - Re L | = 7(n(f) - ReL) 2 < vW) - ReL) 2 + (v(f) - ImL) 2 

= I fit) ~ L I • 
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EXAMPLE 2.10 


Continuity 

Differentiability 


EXAMPLE2.il 


Chain rule 


Left-hand limit 
Right-hand limit 


DEFINITION 2.3 

Piecewise continuous 
function 


From this it follows that if lim ? _> a | /(f) — L | =0, then lim f _» a uit ) = ReL. 
Similarly one proves that v(f) = Im L. This completes the proof. g 

We show that for each real u> one has: \im t ^. oo e l(0t /t = 0. Since \e lu ‘ t /t\ = 
1 /I and limf-^oo 1 ft = 0 we have lirn^oo \e uot /t\ = 0 and hence, according to 
theorem 2.3, linir_>oo e iu>t /t = 0. ^ 

Concepts like continuity and differentiability of a function are defined using lim¬ 
its. For instance, a function is continuous at t = a if lim f -s. a f(t) = /(a) and 
differentiable at t = a if lim f _ s . fl (/(f) — /(a))/(f — a) exists. One can show (this 
is not very hard, but it will be omitted here) that for a complex-valued function 
/(f) = u(t) + iv(t). the continuity of /(f) is equivalent to the continuity of both 
the real part u(t ) and the imaginary part i'(f), and also that the differentiability of 
/(f) is equivalent to the differentiability of ult) and v(f). Moreover, one has for the 
derivative at a point f that 

/'(f) = u'(f) + iv'(t). (2.19) 

Consequently, for the differentiation of complex-valued functions the same rules ap¬ 
ply as for real-valued functions. Complex numbers may be considered as constants 
here. 

If /(f) = e at with a e C, then fit) = ae at . We can show this as follows: put 
a = x + iy and write /(f) as /(f) = e xt e lyt = e xt cosyf + ie xt sin yt. The real 
and imaginary parts are differentiable everywhere with derivatives e xt (x cos yt — 
y sin yt) and e xt (x sin yt + y cos yf) respectively. So 

/'(f) = xe xt (cos yt + i sin yf) + iye xt (cos yf + i sin yf) 

= (x + iy)e xt e iyt = ae at . 

■4 

With the chain rule we can differentiate a composition f(g(t)) of two functions. 
The function /(f), however, is defined on (a part of) R. Hence, in the composition 
g(t ) should also be a real-valued function. The chain rule then has the usual form 

^-/(s(0) = f'(g(t))g'(t). 
dt 

A consequence of this is: 

x[/(f)]" =n[/(f )]" _1 / , (0 f°r« = 1,2. 

dt 

Now that the concepts continuity and differentiability of complex-valued func¬ 
tions have been introduced, we will proceed with the introduction of two classes 
of functions that will play an important role in theorems on Fourier series, Fourier 
integrals and Laplace transforms. 

The first class consists of the so-called piecewise continuous functions. To start 
with, we define in the usual manner the left-hand limit f{t—) and right-hand limit 
/(f+) of a function at the point f: 

f(t-) = lim f{t — h) and /(f+) = lim f(t + //), 

/z TO /z to 

provided these limits exist. 

A function /(f) is called piecewise continuous on the interval [a, b\ if fit) is con¬ 
tinuous at each point of {a , b), except possibly in a finite number of points t\, ti . 

f„. Moreover, f{a+), fib—) and /(f,+), / (f,- —) should exist for i = 1, ..., n. 
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A function fit) is called piecewise continuous on R if f{t) is piecewise continuous 
on each subinterval [a, b] of R. 

One can show that a function /(f) which is piecewise continuous on an interval 
[a, b] is also bounded on [a, b\, that is to say: there exists a constant M > 0 such 
that for all t in [a, b] one has \ fit) \ S M. Functions that possess areal or imaginary 
part with a vertical asymptote in [a, b] are thus not piecewise continuous on [a, b]. 
Another example is the function /(f) = sin(l/f) for f ^ 0 and /(0) = 0. This 
function is continuous everywhere except at f = 0. Since /(0+) does not exist, this 
function is not piecewise continuous on [0, 1] according to our definition. 

Note that the function value /(f) at a point f of discontinuity doesn’t necessarily 
have to equal /(f+) or fit—). 

A second class of functions to be introduced is the so-called piecewise smooth 
functions. This property is linked to the derivative of the function. For a piecewise 
continuous function, we will mean by f the derivative of / at all points where it 
exists. 

DEFINITION 2.4 

Piecewise smooth function 


In figure 2.5 a graph is drawn of a real-valued piecewise smooth function. 


A piecewise continuous function fit) on the interval [a, £>] is called piecewise 
smooth if its derivative f' it ) is piecewise continuous. 

A function is called piecewise smooth on R if this function is piecewise smooth on 
each subinterval [a, b] of R. 



FIGURE 2.5 

A piecewise smooth function. 


Left-hand derivative 
Right-hand derivative 


There are now two possible ways of looking at the derivative in the neighbour¬ 
hood of a point: on the one hand as the limits f\t+) and f'it —); on the other 
hand by defining a left-hand derivative /1(f) and a right-hand derivative f\_(t) as 
follows: 


/1(f) = lint 

ft to 


fit + h) - fjt-) 
h 


f+it) = lint 
^ h \0 


fit + h) - /(f+) 
h 


( 2 . 20 ) 


provided these limits exist. Note that in this definition of left-hand and right-hand 
derivative one does not use the function value at f, since /(f) need not exist at the 
point f. Often it is the case that /1(f) = f'it—) and f^_(t) = f\t+). This holds 
in particular for piecewise smooth functions, notably at the points of discontinuity 
of /, as is proven in the next theorem. 
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THEOREM 2.4 


EXAMPLE 


Definite integral 


Let f(t ) be a piecewise smooth function on the inten’al [a,b\ Then f' + {a) = 
f'(a+), f'_(b ) = f'(b-) and for all a < t < b one has, moreover, that f!_(t) = 
f'(t-)and 4(0 = /'(*+)• 

Proof 

We present the proof for right-hand limits. The proof for left-hand limits is anal¬ 
ogous. So let t e [a, b) be arbitrary. Using the mean value theorem from calcu¬ 
lus we will show that the existence of f'(t+) implies that /+(f) exists and that 
f'(t+) — f\(t). Since / and f' are both piecewise continuous, there exists an 
h > 0 such that / and f have no point of discontinuity on (f, t + h]. Possibly / 
has a discontinuity at t. If we now redefine / at t as f(t+), then / is continuous on 
[/, t + h]. Moreover, / is differentiable on (f, t + h). According to the mean value 
theorem there then exists a f e ( t,t + h ) such that 

fit + h) - f(t+) = 

h ' ' 

Now let h l 0, then § j, t. Since = lim^ ? f'(f) exists, it follows from 

(2.20) that f + (t) exists and that f'(t+) = f’ + {t). g 


When a function is not piecewise smooth, the left- and right-hand derivatives 
will not always be equal to the left- and right-hand limits of the derivative, as the 
following example shows. 


Let the function /(f) be given by 


m = 


f-sin(l/f) for f t^O, 


0 


for t = 0. 


The left- and right-hand derivatives of /(f) at f = 0, calculated according to (2.20), 
exist and are equal to 0. However, if we first calculate the derivative f'(t), then 


2f sin(l/f) — cos(l/f) for f t^O, 
0 for f = 0. 


It then turns out that //0+) and f'(0— ) do not exist, since cos(l/f) has no left- or 
right-hand limit at r = 0. ^ 


The theory of the Riemann integral and the improper Riemann integral for real¬ 
valued functions can easily be extended to complex-valued functions as well. For 
complex-valued functions the (improper) Riemann integral exists on an interval if 
and only if both the (improper) Riemann integral of the real part u(t) and the imag¬ 
inary part v (f) exist on that interval. Moreover, one has 


rb rb rb 

/ f(t)dt= / u(t)dt + i / v(t)dt. 
Ja Ja Ja 


( 2 . 21 ) 


Here a — —oo or b = oo is also allowed. We recall that the value of an integral 
does not change by altering the value of the function at the possible jump discontinu¬ 
ities. From (2.21) the following properties of definite integrals for complex-valued 
functions immediately follow: 


[ f(t)dt= [ f(t)dt , 

Ja Ja 

rb rb rb rb 

Re / f{t)dt= / Ref(t)dt and Im / f(t)dt= / Im f{t)dt. 
Ja Ja Ja Ja 
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THEOREM 2.5 


EXAMPLE 2.12 


EXAMPLE 2.13 


The fundamental theorem of calculus for complex-valued functions is no different 
from the one for real-valued functions. Here we will formulate the fundamental 
theorem for piecewise continuous functions, for which we state without proof that 
they are Riemann integrable. 

Let f(t) be a piecewise continuous function defined on the interval [a, b]. Let 
F{x) = f* f(t)dt. Then F is continuous and piecewise smooth on [a, b]. 

From the preceding theorem one can then derive that for continuous and piece- 
wise smooth complex-valued functions, the rule for integration by parts can be ap¬ 
plied in the same way as the rule for integration by parts of real-valued functions. 

We calculate the integral Jq te 2it dt by applying the rule for integration by parts. 


r te 2i 'dt = 1 [ 

Jo 2 i Jo 


t(e 2l, y dt = 


2 i Jo 

-ne 2ni - - 

2 i 2 i 


—te 
2 i 


lit 


JO 


- f 

2 i Jo 


„2 it 


(, t)'dt 


7V 

2i 


J2ni 


c7T 

/ e 2lt dt — 

7V 

— -h 

i — 

CN 

1_ 

Jo 

2 i 

L4 J 

TV 



- J) =2T 




The following inequality is often applied to estimate integrals: 


[ b fit) dt < I'* | fit) | dt 
Ja J a 


for b > a. 


( 2 . 22 ) 


For real-valued functions this is a well-known inequality. Here we omit the proof 
for complex-valued functions. In fact one can consider this inequality as a general¬ 
ization of the triangle inequality (theorem 2.1). A direct consequence of inequality 
(2.22) is the following inequality. If | f(t) \ < M on the integration interval [a, b ], 
then 


f 

Ja 


f(t)dt 


rb rb 

/ \f(t)\dt< M dt = M(b — a). 

Ja Ja 


For all complex s with Re s ^ 0 and real T > 0 one has 
T e~ st dt\<l \e~ st \d.t=\ e - (Res) ‘dt = — 

0 Rei 


[ T e~ s, dt < [ T \e~ st \ dt= [ 

Jo Jo Jo 


EXERCISES 

2.13 Determine the derivative of the following functions: 
a /(0 = t ^— , 

1 + it 

b f(t) = e- 1 ' 2 . 

2.14 Let a positive real number o>q be given. Put T — 2n/ u>q. Calculate fT t 2 e ia ‘° t dt. 
Show that 


f'-L. 

Jo 2-e" 


dt 


< 1. 


2.15 
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DEFINITION 2.5 

Convergence of sequences 


EXAMPLE 2.14 


THEOREM 2.6 
EXAMPLE 2.15 


Divergence of sequences 


2.4 Sequences and series 

2.4.1 Basic properties 

The concept of an infinite series plays a predominant role in chapters 3 to 5 and will 
also return regularly later on. We will assume that the reader is already acquainted 
with the theory of sequences and series, as far as the terms of the sequence or the 
series consist of real numbers. In this section the theory is extended to complex 
numbers. In general, the terms of a sequence 

(i a n ) with n = 0, 1, 2,... 

will then be complex numbers, as is the case for the terms of a series 

oo 

^ ' On = oq 4- a i + ■ ■ ■. 
n =0 

For limits of sequences of complex numbers we follow the same line as for limits of 
complex-valued functions. Assuming that the concept of convergence of a sequence 
of real numbers is known, we start with the following definition of convergence of 
a sequence of complex numbers. 

A sequence ( a„ ) of complex numbers with u n = Rea„ and v n — Im a n converges 
if both the sequence of real numbers (u n ) and the sequence of real numbers (v n ) 
converge. Moreover, the limit of the sequence (a n ) then equals 

lim a n = lim u n + i lim v„. 
n—>oo h—>- oo n—>oo 

Let the sequence ( a n ) be given by 

a„ = n{e'! n — 1) with n = 0, 1, 2. 

Since e'! n = cos(l/«) + i sin(l/n) one has u n — Rea„ = n(cos(l//r) — 1) 
and v n = Imo„ = nsin(l/n). Verify for yourself that \im n ^. 00 u n = 0 and 
lim ; ,_>.c>o Vn = 1. Hence, the sequence (a n ) converges and lim„_>.oo o n = i. ^ 

Our next theorem resembles theorem 2.3 and can also be proven in the same way. 

A sequence ( a n ) converges and has limit a if and only if lim n _*.oo I a n — a \ — 0. 

For complex z one has 

lim z n = 0 if | z | < 1. 

n— >-oo 

We know that for real r with — 1 < r < 1 one has lim„_ s . 00 r" = 0. So if | z I < 1, 
then lintn-^oo | z n \ = limn-j.oo | z I" = 0. Using theorem 2.6 with a = 0 we 
conclude that limn-^oo z n =0. ^ 

In the complex plane | a„ — a \ is the distance front a n to a. Theorem 2.6 states 
that for convergent sequences this distance tends to zero as n tends to infinity. 

A sequence diverges, or is called divergent, if the sequence does not converge. 
All kinds of properties that are valid for convergent sequences of real numbers are 
valid for convergent sequences of complex numbers as well. We will formulate the 
following properties, which we immediately recognize from convergent sequences 
of real numbers: 

Let ( a n ) and ( b n ) be two convergent sequences such that lim ; ,_>.oo a n = a and 
lini/j^oo b n = b. Then 
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Partial sum 


DEFINITION 2.6 

Convergence of a series 

Sum of a series 

EXAMPLE 2.16 
Geometric series 


THEOREM 2.7 


a + fh n ) = aa + fib for all a, ft e C, 

b lim/,^oo a n b n = ab, 
c lim„^oo a„/b n = a/b if b 0. 

Now that we know what a convergent sequence is, we can define convergence of 
a series in the usual way. For this we use the partial sums s„ of the sequence (a„): 
n 

Sn = y ' afc = do + a l + ■ ■ ■ + Cln • 
k =0 


A series YlnLo a " * s ca ^ e ^ convergent if and only if the sequence of partial sums 
(s n ) converges. 

When 5 = lim„_ s . 00 s n , we call s the sum of the series. For a convergent series 
the sum is also denoted by Yt=o a n , so s = Yln=o a,x • 

Consider the geometric series YlnLo z ” ratio z e C. The partial sum is 

equal to .s„ = 1 + z + z~ + • • • + z” ■ Note that this is a polynomial of degree 
n. When z — 1, then we see by direct substitution that s n = n + 1. Hence, the 
geometric series diverges for z = 1, since lim„^c>o s n = oo. Multiplying s n by the 
factor 1 — z gives 

(1 - z)s n = 1 + z + z 2 4-1- z n - z(l + z + z 2 H-1- z n ) = 1 - z" +1 . 

For z 7 ^ 1 one thus has 
1 - z n+l 

Syt — . 

1 -z 

For | z | < 1 we have seen that lim „_ ! . 00 z” = 0 (see example 2.15); so then the 
series converges with sum equal to 1/(1 — z). We write 

oo , 

£z" = -- if I z I < 1 • 

to 1 - z 

Since for | z | > 1 the sequence with terms z n does not tend to zero, the series 
diverges for these values of z. ^ 

Just as for sequences, the convergence of a series can be verified on the basis of 
the real and imaginary parts of the terms. For sequences we used this as a definition. 
For series we formulate it as a theorem. 

Let (a n ) be a sequence of numbers and u n — R ea n and v n = Imfl H . Then the series 
£,7i 0 ci n converges if and only if both the series YtLo u n an d the series o v « 
converge. 

Proof 

Let (j„), (r n ) and (t n ) be the partial sums of the series with terms a n , u n and v n 
respectively. Note that s n = r n + it n . According to the definition of convergence of 
a sequence, the sequence (^„) converges if and only if both the sequence (r„) and 
the sequence (t n ) converge. This is precisely the definition of convergence for the 
series with terms a n , u„ and v„. g 


From the preceding theorem we also conclude that for a convergent series with 
terms a n = u n + iv„ one has 


oo 

£ 

n =0 


oo oo 

y ] Un + i y ] Vn • 

n =0 n =0 
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THEOREM 2.8 


THEOREM 2.9 


EXAMPLE 2.17 
Harmonic series 


For convergent series with complex terms, the same properties hold as for conver¬ 
gent series with real terms. Here we formulate the linearity property, which is a 
direct consequence of definition 2.6 and the linearity property for series with real 
terms. 

Let fl » an d bn be convergent series with sum s and t respectively. Then 

oo 

i n + fib,,) = as + fit for alia, ft e C. 

n =0 

The next property formulates a necessary condition for a series to converge. 

If the series YUnLo a n converges, then limn-^oo a n = 0. 

Proof 

If the series Yl'nLo a n converges and has sum .s, then 

lim a n = lim (s n — s„_i) = lint s n — lim .t„_i = s — s = 0. 
n—>oo n—>oo n—n—>oo 

■ 

As a consequence we have that lint/j^co a n i=- 0 excludes the convergence of 
the series. The theorem only gives a necessary and not a sufficient condition for 
convergence. To show this, we consider the harmonic series. 

Series of the type with p a real constant, are called harmonic series. 

From the theory of series with real terms it is known that for p > 1 the harmonic 
series is convergent, while for p < 1 the harmonic series is divergent. Hence, for 
0 < p < 1 we obtain a divergent series with terms that do tend to zero. ^ 


DEFINITION 2.7 

Absolute convergence 


THEOREM 2.10 
Comparison test 


2.4.2 Absolute convergence and convergence tests 

For practical applications one usually needs a strong form of convergence of a se¬ 
ries. Convergence itself is not enough, and usually one requires in addition the 
convergence of the series of absolute values, or moduli, of the terms. 

A series YlnLo a " i,s called absolutely convergent if the series YlnLo I I con ~ 
verges. 

The series of the absolute values is a series with non-negative real terms. Con¬ 
vergence of series with non-negative terms can be verified using the following test, 
which is known as the comparison test. 

When (a n ) and (b n ) are sequences of real numbers with 0 < a n < b„ for n = 
0, 1 , 2, ..., and the series YlnLo bn converges, then the series a n converges 

as well. 

Proof 

Let (s n ) bethe partial sums of theseries with terms a n . Then — s n = fl n +i > 0. 
So > s,i, which means that the sequence (s n ) is a non-decreasing sequence. It 
is known, and this is based on fundamental properties of the real numbers, that such 
a sequence converges whenever it has a upper bound. This means that there should 

be a constant c such that s n < c for all n = 0, 1, 2.For the sequence ( s „) this is 

easy to show, since it follows from a n < b n that 

s n = oq + a\ + • • • + a n < bo + b\ + • • • + b n 
— bo + b\ + ■ ■ ■ + b n + b n _ |_i + • • •. 
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THEOREM 2.11 


THEOREM 2.12 


THEOREM 2.13 


The sequence (s n ) apparently has as upper bound the sum of the series with terms 
b n - This sum exists since it is given that this series converges. This proves the 
theorem. g 

Absolutely convergent series with real terms are convergent. One can show this 
as follows. Write a n = b n — c n with b n = | a n | and c n — \a n \ — a, ,. It is 
given that the series with terms b n converges. The terms c n satisfy the inequality 
0 < c n < 2 | a„ I. According to the comparison test, the series with terms c n then 
converges as well. Since a n = b„ — c n , the series with terms a n thus converges. For 
series with complex terms, the statement is a consequence of the next theorem. 

Let (a n ) be a sequence of numbers and let u n — Rea„ and v n = Im%. The series 
=o a n converges absolutely if and only if both the series u n and Yf^Lo v n 

converge absolutely. 

Proof 

For the terms u n and v n one has the inequalities | u n | < \a n \, \v n \ < \ a„ |. If 
the series with the non-negative terms | a n | converges, then we know from the com¬ 
parison test that the series with, respectively, terms u n and v n converge absolutely. 
Conversely, if the series with, respectively, terms u n and v n converge absolutely, 
then the series with the non-negative terms | u n | + | v n | also converges. It then 

follows from the inequality \a n \ = yj'u}, + v« < | u n \ + \ v n | and again the com¬ 
parison test that the series with terms | a n | converges. This means that the series 
with terms a n converges absolutely. p 

An absolutely convergent series is convergent. 

Proof 

Above we sketched the proof of this statement for series with real terms. For series 
with, in general, complex terms, the statement follows from the preceding theorem. 
Specifically, when the series with complex terms is absolutely convergent, then the 
series consisting of the real and the imaginary parts also converge absolutely. These 
are series of real numbers and therefore convergent. Next we can apply theorem 2.7, 
resulting in the convergence of the series with the complex terms. g 

Of course, introducing absolute convergence only makes sense when there are 
convergent series which are not absolutely convergent. An example of this is the 
series 1)"/n. This series converges and has sum — ln2 (see (2.26) with 

t — 1), while the series of the absolute values is the divergent harmonic series with 
p = 1 (see example 2.17). 

We now present some convergence tests already known for series with real terms, 
but which remain valid for series with complex terms. 

If I a n | < b n for n = 0, 1, ... and YY^Lo converges, then Y^Lo a n converges. 
Proof 

According to the comparison test (theorem 2.10), the series with terms \a n \ 
converges. The series with terms a n is thus absolutely convergent and hence 
convergent. g 

Of course, in order to use the preceding theorem, one should first have available a 
convergent series with non-negative terms. Suitable candidates are the harmonic se¬ 
ries with p > I and the geometric series with a positive ratio r satisfying 0 < r < 1 
(see example 2.16), and all linear combinations of these two as well. 
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EXAMPLE 2.18 


THEOREM 2.14 
D’Alembert’s ratio test 


EXAMPLE 2.19 


Consider the series e inc0 /(n 2 + n) where w is a real constant. The series 

converges absolutely since 


e' nc0 
n 2 + n 


1 1 

- < — 

n 2 + n n 2 


and the harmonic series with terms l/n 2 converges. 


◄ 


A geometric series has the property that the ratio a n+ \/a n of two consecutive 
terms is a constant. If, more generally, a sequence has terms with the property that 


lint 

n—>oo 


a n +1 
a n 


= L 


for some L, then one may conclude, as for geometric series, that the series is abso¬ 
lutely convergent if L < 1 and divergent if L > 1. In the case L = 1, however, one 
cannot draw any conclusion. We summarize this, without proof, in the next theorem. 

Let ( a n ) be a sequence of terms unequal to zero with lim,,-*^ | a n ^_\/a n | = L for 
some L. Then one has: 

a if L < 1, then the series with terms a n converges absolutely; 
b if L > 1, then the series with terms a n diverges. 


Consider the series YlnLl z”/ n p . Here z is a complex number and p an arbitrary 
real constant. Put a n = z n /n p , then 


lim 

n—>oo 


a n- 1-1 
a n 


lim 

n— k> o 


n P z n+l 

(n + 1) Pz n 


lim 

n—>oo 


n + 1 


Izl = Ul- 


Hence, the series is absolutely convergent for | z I < 1 and divergent for | z I > 1. 
If | z I = 1, then no conclusions can be drawn from the ratio test. For p > 1 and 
| z | = 1 we are dealing with a convergent harmonic series and so the given series 
converges absolutely. For p < 1 we are dealing with a divergent harmonic series 
and so the series of absolute values diverges. From this we may not conclude that 
the series itself diverges. Take for example p = 1 and z = — 1, then one obtains the 
series with terms (—!)"/«, which is convergent. ^ 


2.4.3 Series of functions 


In the theory of Fourier series in part 2, and of the z-transform in chapter 18, we 
will encounter series having terms a n that still depend on a variable. The geometric 
series in example 2.16 can again serve as an example. Other examples are 


2 3 

Z Z 


— = 1+ Z + + — +*••+ — + 
n ! 2! 3! 


n =0 


z 

n\ 


for z € €, 


oo 


E 


cos nt 


cos2f cos 3 1 cos nt 

= cos t + — -(- ——- [-■■■ + —^-P ■ ■ ■ 

4 9 n 2 


for tel, 


The first series is an example of a power series. The partial sums of this series are 
polynomials in z, so functions defined on C. In section 2.5 we will study these more 
closely. In this section we will confine ourselves to series of the second type, where 
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Pointwise convergence 


EXAMPLE 2.20 


EXAMPLE 2.21 


EXAMPLE 2.22 


the functions are defined on R or on a part of R. We will thus consider series of the 
type 

oo 

X)/"«• 

n= 0 

Convergence of such a series depends, of course, on the value of t and then the 
sum will in general depend on t as well. For the values of t for which the series 
converges, the sum will be denoted by the function fit). In this case we write 

oo 

m = Y,fnM 

n= 0 

and call this pointwise convergence. For each value of t one has a different series 
for which, in principle, one should verify the convergence. It turns out, however, 
that in many cases it is possible to analyse the convergence for an entire interval. 

Let f„(t) — t n . In example 2.16 it was already shown that YnLo conver g es for 
1 1 1 < 1. with sum 1/(1 — t). This means that the series YnLo fnit) converges 
on the interval (—1, 1) and that fit) = 1/(1 — t). Outside this interval, the series 
diverges. ^ 

One would like to derive properties of f(t) directly from the properties of the 
functions fnit), without knowing the function fit) explicitly as a function of t. 
One could wonder, for example, whether a series may be differentiated term-by- 
term, so whether f' it) — Y fn iO if fit) = Y fnit)- A simple example will show 
that this is not always permitted. 

Let, for example, f n it) = sin(«r)/n 2 , then f n (t) = cos (nt)/n. So for each n > 0 
the derivative exists for all t e R. However, if we now look at Y'LL i fn (0 at t = 0, 
then this equals YLL\ l/ n > which is a divergent harmonic series, as we have seen 
in example 2.17. Although all functions f n it) are differentiable, fit) is not. ^ 

One should also be careful with integration. When, for instance, the functions 
fnit) are integrable, then one would like to conclude from this that fit) is also 
integrable and that 

J f{t)dt = J Y,M)dt=J2{f M) dt 

This is not always the case, as our next example will show. 

2 

Let u n it) = nte~ nt for n = 0, 1, 2, ... and let f n (t) = u„(t) — u n -\ it) for 
n — 1, 2, 3, ... and /q it) = 0. Then one has for the partial sums s„it): 

SniO = flit) 4-F fnit) 

= u\(t) - Lioit) + u 2 it) — U[(t) - 1 - Unit) - u„_i(t) = Unit). 

The sequence of partial sums converges and has limit 

fit) = lim s n it) = lim nte~ nt = 0. 

n—>oo n—>oo 

On the interval (0, 1) one thus has, on the one hand, 

fl ™ 

/ Yf n (t)dt = / f(t)dt = 0, 

Jo „ =0 Jo 
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2.16 


2.17 


2.18 


while on the other hand 



fn(t)dt 



u n (t) — w„_i(f)) dt 


oo 

£[- 

n =1 


1 —nt‘ 


+ \e- (n ~ l)t2 




i) 


oo 

E‘“" 

«=1 


These results are unequal, hence 

P 1 oo oo ^ i 

/ E ^ E / fn (t )dt. 

Jo „^ 0 io 

◄ 

In order to define conditions such that properties like interchanging the order of 
summation and integration are valid, one could for example introduce the notion 
of uniform convergence. This is outside the scope of this book. We will therefore 
always confine ourselves to pointwise convergence, and in the case when one of 
the properties mentioned above is used, we will always state explicitly whether it is 
allowed to do so. 


EXERCISES 


Use the comparison test to prove the convergence of: 


cxj - 

E-3^7 


n =0 
oo 


n J + i 


E sm n 

~JT' 


n= 1 

SP, c -n(l +0 


E 

n= 1 


Determine which of the following series converge. Justify each of your answers. 

oo 


E 

n= 1 
OO '■)!! 

b E 


n\ 

2 " + 1 


3” + n 

E h 

(1 + i' 


n= 1 
oo 


r; (1 + 0" 

Show that the following series of functions converges absolutely for all f. 

oo 2 int 

y — _ 

“ 2n 4 + 1 


n =0 


2.5 Power series 

As final subject of this chapter, we consider some properties of complex power 
series. Power series were already introduced in section 2.4.3. These series have a 
simple structure. Let us start with a definition. 
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DEFINITION 2.8 

Power series 


EXAMPLE 2.23 


A power series in the complex variable z and with complex coefficients cq, c j, C 2 , 
is a series of the form 

oo 

y C n z n = C 0 + C\Z + C 2 Z 2 -1- c n z n -. 

n =0 


Apparently, a partial sum s„ = cp + c l~ + c 2< 2 + ■ ■ ■ + c n z n is a polynomial 
in z of degree at most n. The geometric series in example 2.16 is an example of 
a power series. Other examples arise from so-called Taylor-series expansions of a 
real-valued function fit) at the real variable t = 0. Such a Taylor-series expansion 
looks like this: 

V* f (n) (0) 

^ n\ 


Here f l '"\ 0) is the value at t = 0 of the nth derivative. In this case we are dealing 
with a real power series. For a large number of functions, the Taylor-series expan¬ 
sion at t = 0 is explicitly known and in the case of convergence the sunt of the 
Taylor-series often represents the function itself. Well-known examples are: 

oo f n t 2 f 3 

= y -r = 1 + t + - + - + • • • for all t , (2.23) 

*-in! 2! 3! 

n= 0 

oo ^2«+l j.3 j.5 

sint = (—1)”- = t -1-• • • for all t, (2.24) 

t-L (2n + l)! 3! 5! 

n=\j 

oo f 2n f 2 f 4 

cos t = y (-1)"-= 1-+- for all t, (2.25) 

*-> (2«)! 2! 4! 

n=0 

oo { n t 2 ,3 

ln(l + t) = V(— 1)' !+1 — = t -b- for — 1 < f < 1. (2.26) 

y n 2 3 

The series above are power series in the real variable t. If we replace the real vari¬ 
able t by a complex variable z, then complex power series arise, for which we first 
of all ask ourselves: for which complex z does the power series converge and, sub¬ 
sequently, what is the sum of that power series? If, for example, we replace the 
real variable t in (2.23) by the complex variable z, then one can wonder if the series 
converges for all z as well, and if its sum is then still equal to the exponential func¬ 
tion e z . The answer is affirmative, but the treatment of functions defined on C will 
be postponed until chapter 11. In this section we will only go into the question for 
which values of z a power series converges. We first present some examples. 

Given is the power series 


oo z n 


2 3 

Z Z 


E 4 . 4 4 

— = ! + z+ — + — + 


n =0 


To investigate the values of z for which this series converges, we put a n = z n /n\ 
and apply the ratio test: 


a n +1 
a n 


n\ 

(n + 1)! 


Izl 


I z I 
n + 1 
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EXAMPLE 2.24 


EXAMPLE 2.25 


EXAMPLE 2.26 


We see that lim ;( _ s . 00 | a n+ \/a n = 0 < 1 for all z. The series thus converges for 
all z. M 


Given is the power series 


E 

n= 1 


(-1)' ,+1 „ _ z\z 3 
n Z Z 2 + 3 


+ ■■■• 


To investigate the values of z for which this series converges, we put a n = 
(—1 ) n+l z n /n and apply the ratio test: 


We see that lim„_ s . 00 | a n+ \/a n \ = | z | and so the series converges absolutely for 
| z I < 1 and diverges for | z\ > 1. For | z | = 1 no conclusion can be drawn front 
the ratio test. For z = 1 we know from (2.26) (substitute t = 1) that the series 
converges and has sum In2, while for z = -lwe know that the series diverges. For 
all other values of z on the unit circle one can show, with quite some effort, that the 
series converges. ^ 


Given is the power series 

oo 

J2"\z n = 1 + z + 2!z 2 + • • •. 

n =0 


To investigate the values of z for which this series converges, we put a n = n \z n and 
apply the ratio test: 


a n +1 
On 


(n+ 1 )! 
n ! 


I Z | 


(n + 1) I z I • 


We see that lim„_ s . 00 | a n+ \/a n | = oo for z ^ 0 and so the series diverges for all 
z ^ 0 and it converges only for z = 0. ^ 


Given is the power series 

OO 

Y. n 2 l n z n =2z+ 16z 2 H-. 

n =0 


To investigate the values of z for which this series converges, we put a n = n 2 2 n z n 
and apply the ratio test: 


a n +1 
a n 


n + 1 
n 


2 

|2z|. 


We see that lim^-^oo | a n +l/a n \ = 2 | z I and so the series converges absolutely for 
| z I < t and it diverges for |z! > o-If|z| = j, then | a„ \ — n and this sequence 
does not tend to zero. Hence, on the circle with radius \ the series diverges. ^ 


The previous examples suggest that for each power series there exists a number 
R such that the power series converges absolutely for | z | < R and diverges for 
| z | > R. This is indeed the case. The proof will be omitted. Usually one can find 
this number R with the ratio test, as in the previous examples. Summarizing, we 
now have the following. 
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Radius of convergence 

Circle of convergence 


THEOREM 2.15 

EXAMPLE 2.27 


2.20 


2.21 

2.22 


For a power series in z one of the following three statements is valid, 
a The power series converges only for z — 0. 

b There exists a number R > 0 such that the power series converges absolutely 
for all z with Ul < R and diverges for | z I > R. 
c The power series converges for all z. 

The number R is called the radius of convergence. In case a we put R = 0 and in 
case c we put R = oo. The radii of convergence of the power series in examples 
2.23 up to 2.26 are, respectively, R = oo, /? = 1, R = 0, R = j- 

If R is the radius of convergence of a power series, then this power series has a 
sum /(z) for | z | < R. In the complex plane the points with | z | = R form a circle 
of radius R and with the origin as centre, and this is sometimes called the circle of 
convergence. For example, the geometric series in example 2.16 has sum 1/(1 — z) 
for | z | < 1. 

Continuity and differentiability of functions on C will be defined in chapter 11. 
As far as the technique of differentiation is concerned, there is no difference in 
differentiating with respect to a complex variable or a real variable. Hence, the 
derivative of 1/(1 — z) is equal to 1 /(I — z) 2 . One can prove that the sum of a power 
series is a differentiable function within the circle of convergence. Indeed, we have 
the following theorem. 

The power series Y^=o c nZ n and nc n z"~ l have the same radius of conver¬ 

gence R. Moreover, one has: if f(z) — Y^Lo c 'nZ n for |z| < R, then f'(z) — 
ZZinc n z"- l for\z\<R. 

We know that Yn~o z n — 1/(1 — z) for | z | < 1. Applying theorem 2.15 gives 

oo , 

y nz n ~ l = y for I Z I < 1. 

h d -*) 2 

We can apply this theorem repeatedly (say k times) to obtain the following result: 

£ n(n - 1} " ■ - k + Dz" - * = (1 _ g)t+ T - 

Using binomial coefficients this can be written as 



EXERCISES 


oo 

Determine the radius of convergence of the series 

n =0 


2 n 

n- + 1 


z 


2/7 


Determine the values of z for which the following series converges, and, moreover, 
determine the sum for these values. 



Show that the sum /(z) of z 2n /n\ satisfies f'(z) = 2z/(z). 

For which values of z does the series 2 n z~ n converge absolutely? 
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2.23 


2.24 


SUMMARY 


Complex numbers play a fundamental role in the treatment of Fourier and Laplace 
transforms. The functions that occur are mostly functions defined on (a part of) R 
or on (a part of) the complex plane C, with function values being complex numbers. 
Important examples are the time-harmonic functions e la>t with frequency a> and 
defined on R, and rational functions defined on C. 

Using complex numbers one can factorize polynomials entirely into linear fac¬ 
tors. As a consequence, when allowing complex factors, the partial fraction expan¬ 
sion of a rational function (for which the degree of the numerator is smaller than 
the degree of the denominator) will consist of fractions with numerators being just 
constants and denominators being polynomials of degree one or powers thereof, de¬ 
pending on the multiplicity of the various zeros. If the rational function has real 
coefficients, then one can also expand it as a sum of fractions with real coefficients 
and having denominators which are (powers of) linear and/or quadratic polynomials. 
The numerators associated with the quadratic denominators may then be linear. 

The differential and integral calculus for complex-valued functions and for real¬ 
valued functions are very similar. If a complex-valued function fit) = u(t) + iv(t) 
with t € R has a certain property, like continuity or differentiability, then this means 
that both the real part u(t) and the imaginary part v(f) have this property. The 
derivative f'(t) of a complex-valued function equals u'(t ) + iv'(t). As a result, 
the existing rules for differentiation and integration of real-valued functions are also 
valid for complex-valued functions. Classes of complex-valued functions that may 
appear in theorems on Fourier and Laplace transforms are the class of piecewise 
continuous functions and the class of piecewise smooth functions. 

The theory of sequences and series of real numbers can easily be extended to a 
theory of sequences and series of complex numbers. All kinds of properties, such 
as convergence and absolute convergence of a series with terms a n = u n + iv n , 
can immediately be deduced from the same properties for the series with real terms 
u n and v n . Convergence tests, such as the ratio test, are the same for series with 
complex terms and for series with real terms. 

Just as real power series, complex power series have a radius of convergence R. 
A power series in the complex variable z converges absolutely for | z I < R , that is 
within a circle in the complex plane with radius R (the circle of convergence), and 
diverges for | z | > R . Within the circle of convergence, the sum of a power series 
can be differentiated an arbitrary number of times. The derivative can be determined 
by differentiating the power series term-by-term. 


SELFTEST 


Determine the (complex) zeros and their multiplicities for the following polynomials 

a P(z)=z 3 - 1, 
b P(z) = (z 2 + ;) 2 + 1, 
c P(z) = z 5 + 8z 3 + 16z. 

Determine the partial fraction expansion of 


(z + l) 3 



2 Mathematical prerequisites 


2.25 


2.26 

2.27 


2.28 


2.29 

2.30 


Determine the partial fraction expansion, into fractions with real coefficients, of 

. z 2 -6z + 7 

F(z) = 


n + i n 


(z 2 - 4z + 5) 2 ' 

Calculate the integral fY e'' cos t dt. 

Find out if the following series converge: 

^ ( 2 — i 

a L 

n =1 
oo 

b E „ 

n =1 

Given is the series of functions 

OO ry—n 

Y—e in ' sin t. 

i n 

n =1 

Show that this series converges absolutely for all t. 

Show that if the power series YHnLo c >’Z" has radius of convergence R, then the 
power series c nZ 2n has radius of convergence R 

a Calculate the radius of convergence R of the power series 

x 2 ' d + o 2 " „ 


n =0 


n + 1 


b Let f(z) be the sum of this power series. Calculate zf'(z) + /(z). 



Part 2 

Fourier series 


INTRODUCTION TO PART 2 


The Fourier series that we will encounter in this part are a tool to analyse numerous 
problems in mathematics, in the natural sciences and in engineering. For this it is 
essential that periodic functions can be written as sums of infinitely many sine and 
cosine functions of different frequencies. Such sums are called Fourier series. 

In chapter 3 we will examine how, for a given periodic function, a Fourier series 
can be obtained, and which properties it possesses. In chapter 4 the conditions will 
be established under which the Fourier series give an exact representation of the 
periodic functions. In the final chapter the theory of the Fourier series is used to 
analyse the behaviour of systems, as defined in chapter 1, and to solve differential 
equations. The description of the heat distribution in objects and of the vibrations 
of strings are among the oldest applications from which the theory of Fourier series 
has arisen. Together with the Fourier integrals for non-periodic functions from part 
3, this theory as a whole is referred to as Fourier analysis. 

Jean-Baptiste Joseph Fourier (1768 - 1830) was born in Auxerre, France, as the 
son of a tailor. He was educated by Benedictine monks at a school where, after 
finishing his studies, he became a mathematics teacher himself. In 1794 he went to 
Paris, where he became mathematics teacher at the Ecole Normale. He declined a 
professorial chair offered to him by the famous Ecole Polytechnique in order to join 
Napoleon on his expedition to Egypt. In 1789 he was appointed governor of part of 
Egypt. Ousted by the English, he left Egypt again in 1801 and became prefect of 
Grenoble. Here he started with heat experiments and their mathematical analysis. 

Fourier's mathematical ideas were not entirely new, but were built on earlier work 
by Bernoulli and Euler. Fourier was, however, the first to boldly state that any 
function could be developed into a series of sine and cosine functions. At first, his 
contemporaries refused to accept this, and publication of his work was held up for 
several years by the members of the Paris Academie des Sciences. The problem was 
that his ideas were considered to be insufficiently precise. And indeed, Fourier could 
not prove that for an arbitrary function the series would always converge pointwise 
to the function values. Dirichlet was one of the first to find proper conditions under 
which a Fourier series would converge pointwise to a periodic function. For the 
further development of Fourier analysis, additional fundamentally new results were 
required, like set-theory and the Lebesgue integral, which was developed in the one 
and a half centuries following Fourier. 

Historically. Fourier’s work has contributed enormously to the development of 
mathematics. Fourier set down his work in a book on the theory of heat, Theorie an- 
alytique de la chaleur, published in 1822. The heat or diffusion equation occurring 
here, as well as the wave equation for the vibrating string, can be solved, under the 
most frequently occurring additional conditions, using Fourier series. The methods 
that were used turned out to be much more widely applicable. Thereafter, applying 
Fourier series would produce fruitful results in many different fields, even though 
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the mathematical theory had not yet fully crystallized. By now, the Fourier theory 
has become a very versatile mathematical tool. From the times of Fourier up to the 
present day, research has been carried out in this field, both concrete and abstract, 
and new applications are being developed. 
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CHAPTER 3 


Fourier series: definition 
and properties 


INTRODUCTION 


Many phenomena in the applications of the natural and engineering sciences are pe¬ 
riodic in nature. Examples are the vibrations of strings, springs and other objects, 
rotating parts in machines, the movement of the planets around the sun, the tides of 
the sea, the movement of a pendulum in a clock, the voltages and currents in elec¬ 
trical networks, electromagnetic signals emitted by transmittters in satellites, light 
signals transmitted through glassfibers, etc. Seemingly, all these systems operate in 
complicated ways; the phenomena that can be observed often behave in an erratic 
way. In many cases, however, they do show some kind of repetition. In order to 
analyse these systems, one can make use of elementary periodic functions or signals 
from mathematics, the sine and cosine functions. For many systems, the response 
or behaviour can be completely calculated or measured, by exposing them to influ¬ 
ences or inputs given by these elementary functions. When, moreover, these systems 
are linear , then one can also calculate the response to a linear combination of such 
influences, since this will result in the same linear combination of responses. 

Hence, for the study of the aforementioned phenomena, two matters are of im¬ 
portance. 

On the one hand one should look at how systems behave under influences that 
can be described by elementary mathematical functions. Such an analysis will in 
general require specific knowledge of the system being studied. This may involve 
knowledge about how forces, resistances, and inertias influence each other in me¬ 
chanical systems, how fluids move under the influence of external forces, or how 
voltages, currents and magnetic fields are mutually interrelated in electrical appli¬ 
cations. In this book we will not go into these analyses, but the results, mostly 
in terms of mathematical formulations, will often be chosen as a starting point for 
further considerations. 

On the other hand it is of importance to examine if and how an arbitrary periodic 
function can be described as a linear combination of elementary sine and cosine 
functions. This is the central theme of the theory of Fourier series: determine the 
conditions under which periodic functions can be represented as linear combinations 
of sine and cosine functions. In this chapter we study such linear combinations (also 
with infinitely many functions). These combinations are called Fourier series and 
the coefficients that occur are the Fourier coefficients. We will also determine the 
Fourier series and the Fourier coefficients for a number of standard functions and 
treat a number of properties of Fourier series. 

In the next chapter we will examine the conditions under which a Fourier series 
gives an exact representation of the original function. 
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LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know what trigonometric polynomials and series are, and know how to determine 
their coefficients 

- know the definitions of the real and complex Fourier coefficients and Fourier series 

- can determine the real and complex Fourier series for a given periodic function 

- can calculate and interpret the spectrum of a periodic function 

- can determine the Fourier series for some standard functions 

- know and can apply the most important properties of Fourier series 

- can develop a function on a given interval into a Fourier cosine or a Fourier sine 
series. 


3.1 Trigonometric polynomials and series 

The central problem of the theory of Fourier series is, how arbitrary periodic func¬ 
tions or signals might be written as a series of sine and cosine functions. The sine 
Sinusoidal function and cosine functions are also called sinusoidal functions. (See section 1.2.2 for a 

description of periodic functions or signals and section 2.4.3 for a description of 
series of functions.) In this section we will first look at the functions that can be 
constructed if we start from the sine and cosine functions. Next we will examine 
how, given such a function, one can recover the sinusoidal functions from which 
it is build up. In the next section this will lead us to the definition of the Fourier 
coefficients and the Fourier series for arbitrary periodic functions. 

The period of periodic functions will always be denoted by T. We would like to 
approximate arbitrary periodic functions with linear combinations of sine and cosine 
functions. These sine and cosine functions must then have period T as well. One can 
easily check that the functions sm(2nt/T), cos(2nt/T). sin(47r t/T), cos(4nt/ T), 
sm(6rtt/T), cos(6nt/T) and so on all have period T. The constant function also 
has period T. Jointly, these functions can be represented by s'm(2nnt/T) and 
cos(27r nt/T), where n e N. Instead of 2 n/T one often writes wq, which means 
that the functions can be denoted by sin iudqI and cos nco$t, where n e N. All these 
functions are periodic with period T. In this context, the constant cdq is called the 
Fundamental frequency fundamental frequency. sinaiQt and cos cogt will complete exactly one cycle on an 

interval of length T , while all functions sin ncoQt and cos ncn^t with n > 1 will com¬ 
plete several cycles. The frequencies of these functions are thus all integer multiples 
of a>Q. See figure 3.1, where the functions sin na>Qt and cos naigt are sketched for 
n = 1,2 and 3. Linear combinations, also called superpositions, of the functions 



FIGURE 3.1 

The sinusoidal functions sin naiQt and cos na>Qt for n — 1,2 and 3. 
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sin mug? and cos nmgt are again periodic with period T. If in such a combination we 
Trigonometric polynomial include a finite number of terms, then the expression is called a trigonometric poly¬ 
nomial. Besides the sinusoidal terms, a constant term may also occur here. Hence, 
a trigonometric polynomial /(?) with period T can be written as 

f(t) = A + Q] cos cogt + b\ sin&>o f + a 2 cos2&jq t + £>2 sin2ft>of 

, . , 2 n 

+ ■ ■ ■ + a n cos nmgt + b n sin nmgt with cog = ■ 

In figure 3.2a some examples of trigonometric polynomials are shown with mg = 1 
and so T = 2 n. The polynomials shown are 


flit) = 2 sin r, 

/ 2 (f) = 2 (sinf — ^ sin 2 f), 

/ 3 (f) = 2(sinr — 4 sin2f + -jr sin3f), 

/ 4 (f) = 2(sinf — 4 sin2f + | sin3f — 4 sin4t). 


a b 



FIGURE 3.2 

Some trigonometric polynomials (a) and the sawtooth function (b). 

In figure 3.2b the sawtooth function is drawn. It is defined as follows. On the 
interval (-T/2, T /2) = (—jr, n) one has f(t) — t, while elsewhere the function is 
extended periodically, which means that it is defined by f(t + kT) = /(?) for all 
Periodic extension leZ. The function /(f) is then periodic with period T and is called the periodic 

extension of the function /(f) = f. The function values at the endpoints of the 
interval (-T/2, T/ 2) are not of importance for the time being and are thus not 
taken into account for the moment. Comparing the figures 3.2a and 3.2b suggests 
that the sawtooth function, a periodic function not resembling a sinusoidal function 
at all, can in this case be approximated by a linear combination of sine functions 
only. The trigonometric polynomials f \, />, h and /4 above, are partial sums of 
the infinite series (— l )" -1 (2/rc)sinnf. It turns out that as more terms are 

being included in the partial sums, the approximations improve. When an infinite 
number of terms is included, one no longer speaks of trigonometric polynomials, 
Trigonometric series but of trigonometric series. The most important aspect of such series is, of course, 

how well they can approximate an arbitrary periodic function. In the next chapter 
it will be shown that for a piecewise smooth periodic function it is indeed possible 
to find a trigonometric series whose sum converges at the points of continuity and is 
equal to the function. 

At this point it suffices to observe that in this way a large class of periodic func¬ 
tions can be constructed, namely the trigonometric polynomials and series, all based 
upon the functions sinna>of and cosnmgt. All functions / which can be obtained 
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as linear combinations or superpositions of the constant function and the sinusoidal 
functions with period T can be represented as follows: 

^ 2it 

f(t) = A + 2_,^ a n cosnoDQt + b n sin/za>oO with coq =—. (3.1) 


This, of course, only holds under the assumption that the right-hand side actually 
exists, that is, converges for all t. 

Let us now assume that a function from the previously described class is given, 
but that the values of the coefficients are unknown. We thus assume that the right- 
hand side of (3.1) exists for all t. It is then relatively easy to recover these coeffi¬ 
cients. In doing so, we will use the trigonometric identities 

sin a cos fl = \ (sin(n + j3) + sin(n — /!)), 

cos a cos /3 = \ (cos(n + /3) + cos(n — /?)), 

sin o' sin P = j (cos(n — /?) — cosin' + /1)). 

Using these formulas one can derive the following results for n. m e N with n ^ 0. 


cos ncoqt dt — 


r • -i 1 

sinn wo? 
na>Q 


sinna>Qt dt = — 


cosntOQt ' 
na>o \-t/2 


cos - natQt dt = - 


i r T r- 


(1 + cos 2 na>Qt)dt 


— ~ r + 


sm2naiQt T 

2 ncoQ _ T f2 3 


sin - na)Qt dt = - 


1 fV 2 


(1 — cos 2na)Qt)dt 


2 1 


sin2ncnot T 

2 n coq _ T j2 — 


sin naiQt cos mcoQt dt 


i r T / 2 


-U 


(sin(/i + m)a>Qt + sin(n — m)a>Qt) dt = 0. 


For n, m e N with n ^ m one has, moreover, that 


rT/2 

I cosncoQt cos mcoQt dt 
J-T/2 


i c T r- 


(cos (n + m)a)Qt + cos(n — m)(OQt ) dt = 0, 


fT/2 

I sin ncoQt sin ?na>Qt dt 
J-T/2 


i r T r- 


(cos (n — m)a>ot — cos (n + m)a>Qt) dt = 0. 
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Orthogonal 


On the basis of the last three equations it is said that the functions from the set 
{sinmwot an d cos natQt with n e Nj are orthogonal: the integral of a product of 
two distinct functions over one period is equal to 0. 

After this enumeration of results, we now return to (3.1) and try to determine 
the unknown coefficients A, a n and b n for a given /(f). To this end we multiply 
the left-hand and right-hand side of (3.1) by cos meoQt and then integrate over the 
interval (—772, T /2). It then follows that 


/. 


T/2 


-T /2 


/(f) cos mcoQt dt 


rT/2 / oo \ 

= / I A + > (a„ cos ncoQt + b n sin nojQt) I cos maiQt dt 

J ~ T r- \ n= 1 / 

rT/2 oo rT 

= A I cosfft&jQf dt + > a n I 
J-T/2 “i 


J-T/2 


cos nrupf cos mcoQt dt 


+ 



sin na>Qt cos mco^t dt. 


In this calculation we assume, for the sake of convenience, that the integral of the 
series may be calculated by integrating each term in the series separately. We note 
here that in general this has to be justified. If we now use the results stated above, 
then all the terms will equal 0 except for the term with cos nco^t cos ma>Qt, where n 
equals m. The integral in this term has value T /2, and so 

r 7/2 T 

I f(t) cos ma>Qt dt = a m —, 

J-T/2 2 

or 

2 r T r- 

a m = — I f(t) cosMcoof dt for m = 1,2,.... (3.2) 

T J-T/2 

This means that for a given /(f), it is possible to determine a m using (3.2). In an 
analogous way an expression can be found for b m . Multiplying (3.1) by sin;7jcoof 
and again integrating over the interval {—T/2, T /2), one obtains an expression for 
b m (also see exercise 3.2). 

A direct integration of (3.1) over {—T/2, T /2) gives an expression for the con¬ 
stant A: 



f(t)dt 


rT/2 / oo \ 

= 1 I A + > {a n cosnaiQt + b„ s'mnaiQt) ] dt 

J-T/2 \ / 




T/2 

T/2 


Adt = T A 


and so 

1 [T/ 2 

A = ~\ f(t)dt. 
1 J-T/2 


The right-hand side of this equality is, up to a factor 2, equal to the right-hand side 
of (3.2) for m = 0, because cosOrogf = 1. Hence, instead of A one usually takes 
a 0 /2: 


oq = 2 A = 


2 [T/2 

T J-T/2 


f (f) dt. 
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All coefficients in (3.1) can thus be determined if f(t) is a given trigonometric poly¬ 
nomial or series. The calculations are summarized in the following two expressions, 
from which the coefficients can be found for all functions in the class of trigonomet¬ 
ric polynomials and series, in so far as these coefficients exist and interchanging the 
order of summation and integration, mentioned above, is allowed: 

2 f T / 2 

a n = — I f(t) cos ncoQt at for n = 0, 1, 2,..(3.3) 

T J-T/2 

2 f T / 2 

b n = — / f(t) sinncoQt dt for n = 1,2. (3.4) 

T J-t/2 

In these equations, the interval of integration is (-T /2, T /2). This interval is pre¬ 
cisely of length one period. To determine the coefficients a n and b n , one can in 
general integrate over any other arbitrary interval of length T. Sometimes the inter¬ 
val (0, T) is chosen (also see exercise 3.4). 

EXERCISES 

3.1 Verify that all functions sinnwot and cos ncoQt with n e N and cop = 2 n/T have 
period T. 

3.2 Prove that if f{t) is a trigonometric polynomial with period T, then b n can indeed 
be found using (3.4). 

3.3 In (3.3) and (3.4) the a n and b n are defined for, respectively, n = 0, 1, 2, ... and 

n — 1,2.Why isn’t it very useful to include £>q in these expressions? 

3.4 Verify that we obtain the same values for a„ if we integrate over the interval (0, T) 
in (3.3). 


3.2 Definition of Fourier series 

In the previous section we demonstrated how, starting from a collection of elemen¬ 
tary periodic functions, one can construct new periodic functions by taking linear 
combinations. The coefficients in this combination could be recovered using for¬ 
mulas (3.3) and (3.4). These formulas can in principle be applied to any arbitrary 
periodic function with period T , provided that the integrals exist. This is an impor¬ 
tant step: the starting point is now an arbitrary periodic function. To it, we then 
apply formulas (3.3) and (3.4), which were originally only intended for trigonomet¬ 
ric polynomials and series. The coefficients a n and b n thus defined are called the 
Fourier coefficients. The series in (3.1), which is determined by these coefficients, 
is called the Fourier series. 

For functions that are piecewise smooth, the integrals in (3.3) and (3.4) exist. 
One can even show that such a function is equal to the Fourier series in (3.1) at 
the points of continuity. The proof of this is postponed until chapter 4. But at 
present, we will give the formal definitions of the Fourier coefficients and the Fourier 
series of a periodic function. In section 3.2.1 we define the Fourier series using 
the trigonometric functions sin/uwiR an d cos na>Qt, in accordance with (3.1). In 
many cases it is easier to work with a Fourier series with functions e ulL ° ot (the time- 
harmonic signals, as in section 1.2.2). This complex Fourier series is introduced in 
section 3.2.2. Through Euler’s formula, these two expressions for the Fourier series 
are immediately related to each other. 
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DEFINITION 3.1 

Fourier coefficients 


Fourier transform 


DEFINITION 3.2 

Fourier series 


EXAMPLE 3.1 


3.2.1 Fourier series 


If, for an arbitrary periodic function /, the coefficients a„ and b„ , as defined by (3.3) 
and (3.4), can be calculated, then these coefficients are called the Fourier coefficients 
of the function /. 

Let fit ) be a periodic function with period T and fundamental frequency wq — 
2n /T, then the Fourier coefficients a n and b n of fit), if they exist, are defined by 

2 [Tr¬ 
an = — / fit) cos ncoQt dt for n = 0,1,2,..., (3.5) 

T J-T/2 

2 f T r- 

b n — I fit) sinncoQt dt for n = 1,2,.... (3.6) 

T J-T/2 

In definition 3.1 the integration is over the interval (-T /2, Tfl). One can, how¬ 
ever, integrate over any arbitrary interval of length T. The only thing that matters is 
that the length of the interval of integration is exactly one period (also see exercise 
3.4). 

In fact, in definition 3.1 a mapping or transformation is defined from functions to 
number sequences. This is also denoted as a transformation pair: 


fit) a„,b n . 


One should pronounce this as: ‘to the function fit ) belong the Fourier coefficients 
a n and b n '. This mapping is the Fourier transform for periodic functions. The func¬ 
tion fit) can be complex-valued. In that case, the coefficients a n and b„ will also 
be complex. Using definition 3.1 one can now define the Fourier series associated 
with a function fit). 

When a n and b n are the Fourier coefficients of the periodic function fit) with 
period T and fundamental frequency a>o = 2n/T, then the Fourier series of fit) is 
defined by 


«0 

2 


oo 

+ jo,, cos ncoQt + b n sin na>Qt). 

n=\ 


(3.7) 


We do emphasize here that for arbitrary periodic functions the Fourier series will 
not necessarily converge for all t, and in case of convergence will not always equal 
fit). In chapter 4 it will be proven that for piecewise smooth functions the series 
does equal fit) at the points of continuity. 

In section 3.1 it was suggested that the series 1)” —1 (2/n) sin nt approxi¬ 

mates the sawtooth function fit), given by fit) — t for t e (— n, n) and having 
period 2 n. We will now check that the Fourier coefficients of the sawtooth function 
are indeed equal to the coefficients in this series. In the present situation we have 
T = 2n, so coq = 2tt/T = 1. The definition of Fourier coefficients can immedi¬ 
ately be applied to the function fit). Using integration by parts it follows for n > 1 
that 

2 [ T l 2 1 [ n 1 [ n . 

a n = — I fit) cos ncoQt dt = — / tcosntdt= — / f(sinnf) dt 
T J—T/2 tt J—ji nit J—jz 

1 1 f 71 1 

= — [t sutntff- -/ sinnt dt = — [cosnf]__. = 0. 

tut nn Jn-n 
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For n = 0 we have 
rT/2 


a o = 


2 r i r T 
1 J-T/2 n J—: 


1 

t dt = — 


l—T/2 

For the coefficients b n we have that 
rT/2 

l—T/2 


-t 

2 


= 0. 


bn — ... 


[T/2 i f* 1 f n . 

I f(t) sin naiQt dt = — / t sinn? dt =-/ t(cosnr) dt 

J-T/2 * J — 7i nn J_ n 


1 


=- [t co&ntyfx -\ - 


nn 


1 r n 

nn J- n 


cos nt dt 


1 1 n 

-(jr cosn?r — (— n) cos (—nn)) H—^— [sinnt]__ 

nn n 2 n 

2n 2 .. __i 2 

-cos nn =-(— 1)" = (— 1)" 

nn n n 


Flere we used that cosnn = (—1)" for n e N. Hence, the Fourier coefficients a n 
are all equal to zero, while the coefficients b n are equal to 2(— 1)" 1 /«■ The Fourier 
series of the sawtooth function is thus indeed equal to 1)” —1 (2/n) sin nt. 

That the partial sums of the series are a good approximation of the sawtooth function 
can be seen in figure 3.3, where YljfLi ( — 1)" _ 1 (2/ n) sin nt is sketched. ^ 



nth harmonic 


FIGURE 3.3 

Partial sums of the Fourier series approximating the sawtooth function. 


When the periodic function / is real, and thus the coefficients a n and b n as well, 
then the nth term in the Fourier series, a n cos ncupf + b n sin nin^t, is called the nth 
harmonic. Instead of the sum of a cosine and a sine of equal frequency, one can 
also write it as a single cosine, in which case, however, a constant will occur in the 
argument. One then has for a n ,b n e M: 

a n cos na>Qt + b n sin ncoQt = Ja„ + b% cos(naiQt + tj> n ) 


where 

bfi 

tan 4> n = -if a n ^ 0, 

a n 

n 

</>« = -- if a n = 0. 
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Amplitude 
Initial phase 


EXAMPLE 


The factor Jof + b„ is the amplitude of the nth harmonic, 0„ the initial phase. 
Hence, the Fourier series can also be written as the sum of infinitely many harmon¬ 
ics, written exclusively in cosines. The amplitude of the nth harmonic tells us its 
weight in the Fourier series. From the initial phase one can deduce how far the nth 
harmonic is shifted relative to cos na>Qt. 

Suppose that a function with period T = 2n has Fourier coefficients flj = 1, 02 — 
1/2, bi = 1/2 and that all other coefficients are 0. Since o>q — 2n/T = 1, the 
Fourier series is then 

1 1 

cos / -1— cos 2r -I— sin 2 1. 

2 2 

The first harmonic is cost, with amplitude 1 and initial phase 0. The amplitude of 
the second harmonic is yj (1/2) 2 + (1/2) 2 = yj\~[2 = s/2/2, while its initial phase 
follows from tan 02 = — 1, so 02 — — jt/4. For the second harmonic we thus have 

1 1 I / / n\ 

- cos 2t -I— sin 2t = - v2 cos ( 2t-) . 

2 2 2 V 4/ 


3.2.2 Complex Fourier series 


In many cases it is easier to work with another representation of the Fourier series. 
One then doesn’t use the functions sin nco^t and cos na>Qt, but instead the functions 
giinuot Euler's formula gives the connection between these functions, making it 
possible to derive one formulation of the Fourier series from the other. According 
to (2.11) one has 

e incoQt _|_ e —incoot e incoot _ incoot 

cos nco^t = - and sin nco^t = -. 

2 2 i 

If we substitute this into (3.7), it follows that 


a 0 ^—r 

— + y (a n cosncopt + b n sinncopt) 

2 n =1 

a 0 °° ( e inWot + e~ inM °’ e ina> 0 t _ e -ina> 0 t 

= T + E p-2- ibn -2- 

= y + E ( 2< fl » - M naot + 2 (a " + ibn)e- inmot j 
n =1 ^ ^ 


oo 

n =1 


c 0 + y^[c n e in ^' Fc-ne-^ 


oo 

- T. 


c n e 


incoQt 


Here the coefficients c n are defined as follows: 

«0 1 1 
c'O — —, c n = -(a n - ib n ), c- n = ~(a n + ib n ) forneN. (3.8) 

Instead of a Fourier series with coefficients a n and b n and the functions cos nco^t 
and sin na>Qt with n e N, one can thus also construct, for a periodic function f(t). 
a series with (complex) coefficients c n and time-harmonic functions e mc ° ot with 
n e Z. The coefficients c n are the complex Fourier coefficients. They can be 
calculated from the coefficients a n and b n using (3.8), but they can also be derived 
directly from the function f(t). To this end, one should substitute for a n and b n 
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DEFINITION 3.3 

Complex Fourier coefficients 


DEFINITION 3.4 

Complex Fourier series 


in (3.8) the definitions (3.5) and (3.6) (see also exercise 3.5). This leads to the 
following definition for the complex Fourier coefficients. 

Let f(t) be a periodic function with period T and fundamental frequency co q = 
2n /T. Then the complex Fourier coefficients c n of fit), whenever they exist, are 
defined by 

i r T / 2 ■ , 

c n = - f (t)e~ lmo °' dt for n el. (3.9) 

1 J-T/2 

The complex Fourier coefficients have the prefix ‘complex' since they’ve been 
determined using complex exponentials, namely, the time-harmonic signals. This 
prefix has thus nothing to do with the coefficients being themselves complex or not. 

Tike the Fourier coefficients from definition 3.1, the complex Fourier coefficients 
from definition 3.3 can also be calculated with an integral over an interval that differs 
from (—772, T /2), as long as the interval has length T. 

The mapping defined by (3.9) will also be denoted by the transformation pair 

fit) c„. 

Using the complex Fourier coefficients thus defined, we can now introduce the com¬ 
plex Fourier series associated with a periodic function fit). 

When c n are the complex Fourier coefficients of the periodic function fit) with 
period T and fundamental frequency cog — 2n /T, then the complex Fourier series 
of fit) is defined by 

oo 

J2 c n e in(O0t . (3.10) 

n=—o o 

Hence, for periodic functions for which the complex Fourier coefficients exist, a 
complex Fourier series exists as well. In chapter 4 it will be proven that for piece- 
wise smooth functions the Fourier series converges to the function at the points of 
continuity. 

In (3.8) the complex Fourier coefficients were derived from the real ones. Con¬ 
versely one can derive the coefficients a n and b„ from c n using 

a n = c n + c- n and b„ = i (c H - C-„). (3.11) 

Therefore, when determining the Fourier series one has a choice between the real 
and the complex form. The coefficients can always be expressed in each other using 
(3.8) and (3.11). From (3.5) and (3.6) it follows that for real periodic functions the 
coefficients a n and b n assume real values. From (3.8) it can then immediately be 
deduced that c n and c~ n are each other’s complex conjugates: 

c~n =cfi when / is real. (3.12) 

Since for real functions c„ and c_„ are each other’s complex conjugates, we obtain 
from (3.11) that 

a n = 2Re c: n and b n = —21m c: n when / is real. (3.13) 

In the next example we calculate for the sawtooth function, which we already en¬ 
countered in section 3.1 and example 3.1, the complex Fourier coefficients in a 
direct way. Moreover, we will verify that the coefficients a n , b n and c„ can indeed 
be obtained from each other. 
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EXAMPLE 3.2 


3.5 


3.6 

3.7 


3.8 


3.9 


On the interval i—n,n) the sawtooth function with period 2jr is given by /(f) = t. 
One has T — In and coq = 1. The complex Fourier coefficients can be calculated 
directly using definition 3.3. For n / 0 it follows from integration by parts that 


1 C T ! 2 


Cn - tL 


-T/2 


f(t)e ~ ina >° f dt = ^~ J n te~ int dt 


linn 

-1 

linn 

-1 


r „i7r 

cn \ 

\te ~ lnt 1 - 

/ e- ,nr r/f 

L J —7T 

J-n \ 


linn 
For n = 0 one has 


i — jnn i / —inn jnn\ 

+ ne H-(e — e ) 

in 


— 1 t 

2?r cos nw-sin nn 1 = -— cos nn = — (— 1) . 


1 f 7 ’/ 2 1 t -77 

CO = ~ / f(t)dt = -— / tdt = 0. 

T J-T/2 -n J-n 

The complex Fourier series of the sawtooth function /(f) = t with period 27r is 
thus equal to Ylm=—oo /'0( — 1)”- That these complex Fourier coefficients 
coincide with the coefficients from example 3.1 can be verified with (3.13) (the 
sawtooth function is real): 


a n = 2Rec„ = 0 for n = 1, 2, 3,..., 

b n = -2Imc„ = —2 —(—T)" for n = 1, 2, 3, ..., 
n 

I/O = 2 cq = 0 . 


Comparing these coefficients with the ones from example 3.1 will show that they 
are equal. ^ 


EXERCISES 


Use the definitions of a n and b n to verify that for a periodic function /(f) with 
period T it follows from (3.8) that 

i r T/2 _• , 

c n — — I f(t)e lna ‘° t dt forn e Z. 

T J-T/2 

Sketch the periodic function /(f) with period In given by /(f) = | f | for f e 
(— n, n) and determine its Fourier series. 


Sketch the periodic function g(t) with period 2 and determine its complex Fourier 
series when g(f) is given for — 1 < f < 1 by 

I 0 for — 1 < f < 0, 

8(n " I e~’ forO < f < 1. 


Sketch the periodic function fit) with period 4 and determine its Fourier series 
when /(f ) is given for — 2 < f < 2 by 


fit) = 


1 for —2 < f < 0, 
f for 0 < f < 2. 


Determine the complex Fourier series of the periodic complex-valued function git) 
given by git) = f 2 + it for f e (— 1, 1) and having period 2. 
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Time domain 


Frequency domain 


Spectrum 
Discrete spectrum 
Line spectrum 
Amplitude spectrum 
Phase spectrum 


EXAMPLE 3.3 


3.3 The spectrum of periodic functions 

The periodic functions, or periodic signals, that we have considered so far, both 
the real and the complex ones, were all defined for I 6 1. Here the variable t is 
often interpreted as a time-variable. We say that these functions are defined in the 
time domain. For these functions the Fourier coefficients c n (or a n and b n ) can be 
determined. Through the Fourier series, each of these coefficients is associated with 
a function of a specific frequency ucoq. The values of the Fourier coefficients tell us 
the weight of the function with frequency nco o in the Fourier series. For piecewise 
smooth functions we will establish in chapter 4 that the Fourier series is equal to the 
function. This means that these functions are completely determined by their Fourier 
coefficients. Since the coefficients c n (or a n and b„) are associated with frequency 
ncoQ, we then say that the function f(t) is described by the Fourier coefficients in 
the frequency domain. As soon as the values c„ are known, the original function in 
the time domain is also fixed. 

In daily life as well, we often interpret signals in terms of frequencies. Sound and 
light are quantities that are expressed in terms of frequencies, and we observe these 
as pitch and colour. 

The sequence of Fourier coefficients c n with n e Z, which thus describe a func¬ 
tion in the frequency domain, is called the spectrum of the function. Since n assumes 
only integer values, the spectrum is called a discrete or a line spectrum. Often, not 
the spectrum itself is given, but instead the amplitude spectrum \ c n | and the phase 
spectrum arg(c n ). Hence, the amplitude and phase spectrum are defined as soon as 
the complex Fourier coefficients exist, also in the case when the function f{t) is 
complex-valued. This definition of amplitude and phase is thus more general than 
the one for the nth harmonic, which only existed in the case when f(t ) was real. 

Figure 3.4 shows the amplitude and phase spectrum of the sawtooth function, for 
which we deduced in example 3.2 that the complex Fourier coefficients c n are given 
by c n = (—1)"(//«) for « / 0 and cq — 0. The amplitude spectrum is thus given 
by | c n | = 1 / | n | for n ^ 0 and | cq | =0, while the phase spectrum is given by 
arg(c H ) = (— 1 )”(jt/ 2) for n > 0 and by arg(c„) = (—l)" -1 (n/2) for n < 0, and 
is undefined for n = 0. ^ 


a b 



FIGURE 3 .4 

The amplitude spectrum (a) and phase spectrum (b) of the sawtooth function. 


EXERCISES 

3.10 Determine and sketch the amplitude and phase spectra of the functions from exer¬ 

cises 3.6 to 3.9. 
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Even function 
Odd function 


Periodic block function 


3.4 Fourier series for some standard functions 

In the preceding sections the Fourier coefficients of the sawtooth function have been 
determined. It will be convenient to know the Fourier series for some other standard 
functions as well. Together with the properties, to be treated in the next section, 
this will enable us to determine the Fourier series for quite a number of periodic 
functions relatively easily. In this section we determine the Fourier series for a 
number of functions. These standard functions and their Fourier coefficients are 
also included in table 1 at the back of the book. The first two functions that will 
be treated are even, that is, fit) = f(—t). The third function will be odd , that is, 

fit) = ~fi~t ). 


3.4.1 The periodic block function 

The periodic function p a jit) with period T > 0 and 0 < a < T and having value 
1 for 1 1 1 < a/2 < T/2 and value 0 for a/ 2 < 1 1 \ < T/ 2 is called the periodic 
block function. Its graph is sketched in figure 3.5. The complex Fourier coefficients 


T-T 
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7/2 
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7 37/2 


FIGURE 3.5 

The periodic block function p fl , 7 -(r). 


of the periodic block function can be calculated for n / 0 using (3.9): 


c n 


i r T / 2 • , i r a / 2 , l 

- / Pa T it)e~ ,nm °’dt = - / e - ,no, °'dt = - 

T J-T/2 T J_ a/ 2 T 

2 / g in m a/2 _ g-iruopa/ 2 \ _ 2 ^ na)Qa / 2 ) 

TncoQ l 2 i J T ncoQ 


g—incoQt 

—incoQ 


all 

—ajl 


For n = 0 it follows that 
1 r 7/2 

c 0 = ~ / Pa,Tit) dt 
l J-T/2 


, ,*,2 
l J—a/2 


1 dt = 


a 

7 


For a given value of a , the Fourier coefficients for n 0 are thus equal to 
2 sin(/7&;o a /2)/ Tncog, which are precisely the values of 2 sin(aJc/2) /Tx evaluated 
at x = iuoq, where n runs through the integers. In figure 3.6 the function f{x) — 
2sin(ax/2)/Tx is drawn; for x = 0 the function is defined by lim x _j.o fi x ) — 
a/T = cq- From this we can obtain the Fourier coefficients of the periodic block 
function by evaluating the function values at mo q for n e Z. One thus has for the 
periodic block function: 


Pa,Tit) 


2 sin(nft)oa/2) 

T na>o 


Here one should take the value lim A ^o 2 sin(a.t/2)/r.r for n = 0. 


(3.14) 
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EXAMPLE 3.4 



FIGURE 3.6 

Evaluating the function values of 2sin(ax/2)/Tx at x = iuoq for n e Z gives the 
Fourier coefficients of the periodic block function. 


When a = T/ 2, the Fourier coefficients of the periodic block function are 

1 1 

c n = — stn(n7r/2) forn ^ 0, co = 
nn 2 

For even n (with the exception of 0) the Fourier coefficients are thus equal to 0 and 
for odd n they are equal to (—1 )( n— l)/ 2 / njr . The amplitude spectrum | c n | of this 
periodic block function is drawn in figure 3.7. ^ 



FIGURE 3.7 

Amplitude spectrum of the periodic block function for a = T/2. 


The partial sums Yl'n=-m c ne mMot of the Fourier series give a better approxima¬ 
tion of the periodic block function as we increase the numbers of terms included. To 
illustrate this, the periodic block function for a = T /2 is drawn in figure 3.8, 
together with the partial sums of the Fourier series for m = 0, 1, 3, 5 and 7. To 
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FIGURE 3.8 

The periodic block function for a = T /2 and approximations using the partial sums 
of the Fourier series. 

do so, the partial sums have been rewritten as follows: 
m m 

X c n e inm 0? = c Q + J2^n ei " m ' +c- n e~ inmt ) 

n=—m 77=1 

tn ginajQt _|_ e —ino)Qt m 

= c 0 + X 2c "-9- = c '0 + X 2c " C0s na>ot 

n= 1 2 n= 1 

= —I- X — (— l )*" -1 )/ 2 cosncoQt. 

2 z —; U7T 

;i=l 
ii odd 

Flence, the Fourier series of the periodic block function contains only cosine terms. 


3.4.2 The periodic triangle function 


The periodic triangle function q a j(t ) with period T is defined for 0 < a < T /2. 
On (— T /2, T /2) it is defined by: 


q a j(t) = 


U I 

1 - — for 1 1 1 < a, 
a 

0 for a < 1 1 1 < T/2. 


The graph of the periodic triangle function is sketched in figure 3.9. For n ^ 0 
the complex Fourier coefficients of the periodic triangle function can be calculated 
using (3.9): 

1 f 7 '/ 2 

c n = ~ q a .T(f)e " ! "° r dt 

l J-T/2 

If 0 t i r a t 

= - (1 + -) e - ,m00 ' dt+- (1 - -) e - ,na, °' dt 

T J-a a T J 0 a 

1 ra t 1 r a t . 

= - (1 - dt+- (1 - -)e~ ,nwo ' dt 

T Jo a T Jo a 

2 [ a t 

= — / (1- )cosna>otdt. 

T Jo a 
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FIGURE 3.9 

The periodic triangle function q a j{t). 


From integration by parts it then follows that 


c n — 


(1-) sinn&pf 

a 


2 1 
T naiQ 

---[cosnctlotln = 

TncDQ a na>Q L JU 


1 [ a 

/ S1 

a Jo 


-\a 

+ 

0 a 
2(1 — cos niDQa) 


sin ncoQt dt 


n^co^aT 


Because 1 — cosn&pa = 2 sin“(/i&>pa/2), we thus have 


Cn — 


4 sin 2 ( na>Qa/2 ) 
n-co^aT 


Since / (1 — \ t\ /a) dt = a, it immediately follows that cp = a/T. For a given 

a , the Fourier coefficients for n ^ 0 equal 4 sin 2 (n idqo /2) /n^uy^aT, which are 
precisely the function values of 4 sin 2 (ax/2)/ax 2 r, evaluated at x = nap, where 
n runs through the integers. In figure 3.10 the function f(x) = 4 sin 2 (ax /2)/ax 2 T 
is drawn. For x = 0 the function is defined by lim^^o f(x) = a/T = cp. By 
evaluating the function values at ruoy for n e Z, one can thus derive the Fourier 
coefficients from this function. For the periodic triangle function we thus have 


da.T(t) 


4 sin 2 (nftpa/2) 
n-ia^aT 


(3.15) 


where for n = 0 one has to take the value lim v _ > o 4 sin“(ax/2)/ax _ r. 


3.4.3 The sawtooth function 

We have already discussed the sawtooth function several times in this chapter. For 
an arbitrary period T it is defined by f(t) = 2 t/T on the interval (-T/2, T /2) 
and extended periodically elsewhere. The ‘standard' sawtooth function thus varies 
between — 1 and +1. Analogous to the previous examples one can derive that the 
complex Fourier coefficients are equal to c n = i(—\) n /nn forn 0 and c q = 0. 

EXERCISES 

3.11 In example 3.4 the Fourier coefficients of the periodic block function have been de¬ 

termined for a = T/2. 

a Determine the Fourier coefficients for a = T /4 and sketch the amplitude 
spectrum. 
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3.12 


3.13 


THEOREM 3.1 

Linearity of the Fourier 
transform 



FIGURE 3.10 

Evaluating the function values of 4 sin 2 (ax/2)/ax 2 T at x = na>Q for n e Z gives 
the Fourier coefficients of the periodic triangle function. 


b Now determine the Fourier coefficients for a = T. What do these Fourier coef¬ 
ficients imply for the Fourier series? 

Determine for a = T/2 the Fourier coefficients and the amplitude spectrum of the 
periodic triangle function from section 3.4.2. 

Determine the Fourier coefficients of the sawtooth function given by f(t) = 2t/T 
on the interval (-T/ 2, T/2) and extended periodically elsewhere, and sketch the 
amplitude and phase spectrum. 


3.5 Properties of Fourier series 

In the previous section Fourier series were determined for a number of standard 
functions. In the same way one can, in principle, determine the Fourier series for 
many more periodic functions. This, however, is quite cumbersome. By using a 
number of properties of Fourier series one can determine in a relatively simple way 
the Fourier series of a large number of periodic functions. These properties have 
also been included in table 2 at the back of the book. 


3.5.1 Linearity 

Fourier coefficients of linear combinations of functions are equal to the same linear 
combination of the Fourier coefficients of the individual functions. This property is 
formulated in the following theorem. 

When the complex Fourier coefficients of f(t) and g(t ) are f n and g n respectively, 
then one has for a, b e C: 

af(t) + bg(t) af„ + bg n ■ 
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EXAMPLE 3.5 


Proof 

The proof of this theorem is a straightforward application of the linearity of integra¬ 
tion. When c n denotes the Fourier coefficients of af(t) + bg(t), then 

1 r T / 2 

c n = - / (a/(0 + bg(t))e- ,n(O0t dt 

1 J-T/2 

a r T / 2 , b r T/2 • , 

= % / f(t)e-‘™°' dt+- g{t)e-' n ^ dt = af n + bg n . 

1 J-T/2 1 J-T/2 

■ 

With the linearity property one can easily determine the Fourier coefficients of linear 
combinations of functions whose individual Fourier coefficients are already known. 
Let / be the periodic function with period 6 as sketched in figure 3.11. The function 



FIGURE 3.11 

Periodic function as a combination of periodic block functions. 


/ is then equal to 2g — 3h, where g and h are periodic block functions, as defined 
in section 3.4.1, with period 6 and, respectively, a = 4 and a = 2. Using (3.14) 
or table 1 and applying theorem 3.1, it then follows that the Fourier coefficients are 
given by 

4 sin(n&;o4/2) 6 sin(/ia»o2/2) 

c n — 7 7 

o ncoQ o na> o 

2 sin(n27r/3) sin(n7r/3) 2 sin(2nrr/3) — 3 sin(njr/3) 

3 n2n/6 u2jt/6 nn 

•4 


3.5.2 Conjugation 

The Fourier coefficients of the complex conjugate of / can be derived from the 
Fourier coefficients of the function itself. How this can be done is the subject of our 
next theorem. 


THEOREM 3.2 

Fourier coefficients of a 
conjugate 


When the Fourier coefficients of f ft) are equal to c n , then 

fit) cZ/- 
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EXAMPLE 


THEOREM 3.3 
Shift in time 


Proof 

Since e ,n( ° ot = e~ ln<0 ° , it follows by direct calculation of the Fourier coefficients 
of /(f) that 

1 fT/2 _ . 1 rT/2 

- / f(t)e-" 1Mor dt = - / f(t)e‘™o'dt 
1 J-T/2 1 J-T/2 

1 fT/2 

= = / fiOe-^-^t dt = cZf. 

' J-T/2 

This property has a special consequence when /(f) is real. This is because we 
then have /(f) = /(f). The Fourier coefficients of /(f) and /(f), whenever these 
exist at least, must then also be equal and hence c n = c- n . This result has been 
derived before, see (3.12). Furthermore, one has for the moduli that | c n \ — \ c- n \ 
and since the moduli of complex conjugates are the same (see (2.3)), this in turn 
equals | C— n |. For a real function it thus follows that | c n \ = | c_„ |, which means 
that the amplitude spectrum is even. We also know that the arguments of complex 
conjugates are each other’s opposite, and so arg(c ;! ) = arg (c - n ) = — arg(c_ ;! ). 
Hence, the phase spectrum is odd. 

The standard functions treated in section 3.4 are all real. One can easily check that 
the amplitude spectra are indeed even. For the sawtooth function one can check 
moreover that the phase spectrum is odd, while the phase spectra of the periodic 
block and triangle functions are zero, and so odd as well. ^ 


3.5.3 Shift in time 

The standard functions treated in section 3.4 were all neatly ‘centred’ around f = 0. 
From these one can, by a shift in time, obtain functions that are, of course, no longer 
centred around f = 0. When the shift equals fq, then the new function will be given 
by fit — to). The Fourier coefficients of the shifted function can immediately be 
obtained from the Fourier coefficients of the original function. 

When c n are the Fourier coefficients of fit), then 

fit - to) ^ e~ in ^c n . 

Proof 

The Fourier coefficients of f(t — to) can be calculated using the definition. In 
this calculation we introduce the new variable r = t — to and we integrate over 
(— T /2, T /2) instead of ((— T /2) + to, (T /2) + fq), since this gives the same result: 

i r T/2 • , 

- / f(t-to)e-" ,Mot dt 
1 J-T/2 

1 f (T/2)+t 0 . ^ 

= e~ lnm ^ - fit- t 0 )e-' nO) o(r - ?o) dit - to) 

T J(- T /2)+r 0 

i r T / 2 

= e -”‘®oto J_ / f {r)e -,mo 0 T dr = e -,mooto . Cn 
T J-T/2 

It follows immediately from theorem 3.3 that the amplitude spectra of fit) and 
fit — to) are the same: \e~ ln(0 ° to c n \ = | c„ [. Hence, the amplitude spectrum of 
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EXAMPLE 


THEOREM 3.4 

Time reversal 


a function does not change when the function is shifted in time. For the phase 
spectrum one has 

arg ( e~ ,na>ot °c n ) = arg (e~" lu>ot °^ + arg(c„) = n arg (e~ lo>ot °^ + arg(c„). 

The phase spectrum thus changes linearly with n, apart from the fact that the argu¬ 
ment can always be reduced to a value in the interval [— n, jr]. 

The periodic block function from example 3.4 is centred around t = 0. The Fourier 
coefficients of the periodic function with /(f) = 1 for 0 < t < T/2 and /(f) = 0 
for — r/2 < t < 0, see figure 3.12, can easily be derived from this. For this periodic 



FIGURE 3.12 

The shifted periodic block function. 


block function one has ty = T /4 and a = T / 2, so the Fourier coefficients are equal 
to 


c n 


1 i Jmt/2 

e-incooto sin(njr /2) = e-inn/i LiJ- 

nn nn 

1 - e~ in7Z _ (-1)" - 1 . 

2inn 2nn 


_ g—imz/2 

^2 i 


Hence, for even n and n ^ 0 one has c n = 0 and for odd n one has c n = —i/nn. 
Furthermore, co — 1 /2. The amplitude spectrum is thus equal to that of the periodic 
block function in example 3.4. ^ 


3.5.4 Time reversal 

The process of changing from the variable t to the variable — t is called time reversal. 
In this case there is again a simple relationship between the Fourier coefficients of 
the functions. 

When c n are the Fourier coefficients of fit), then 
f(~t ) C— n . 

Proof 

A direct application of the definition and changing from the variable — t to r gives 
the proof: 

i r T / 2 i r~ T / 2 

r / f (—t)e~ ina>ot dt = - / /( r)e- in ^- x U{-r) 

l J-T/2 1 JT/2 

i r T ! 2 

= -/ f(T)e-^- n ^dT = c- n . 

I J-T/2 
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EXAMPLE 


EXAMPLE 


3.14 


3.15 

3.16 


3.17 

3.18 


A direct consequence of this theorem is that if /(f) is even, so /(f) = /(—f) 
for all t, then c. n = c~ n . In this case the amplitude spectrum as well as the phase 
spectrum are even. Furthermore, it follows front (3.8) that the coefficients b n of 
the ordinary Fourier series are all 0. Thus, the Fourier series of an even function 
contains only cosine terms. This result is easily understood: the sines are odd, while 
the cosines are even. A series containing sine functions will never be even. When, 
moreover, /(f) is real, then c„ and c_„ are each other's complex conjugate (see 
(3.12)) and in that case the coefficients will be real as well. 

The periodic block function and the periodic triangle function from sections 3.4.1 
and 3.4.2 are even and real. The spectra are also even and real. ^ 

When /(f) is odd, so /(f) = —/(—f), it follows that c n = — c~ n and so the 
spectrum is odd. Since c_„ = for /(f) real, the Fourier coefficients are purely 
imaginary. The spectrum of a real and odd function is thus odd and purely imagi¬ 
nary. Moreover, in the case of an odd function it follows from (3.8) that the coeffi¬ 
cients a n are 0 and that the Fourier series consists of sine functions only. 

The periodic sawtooth function is a real and odd function. The complex Fourier 
coefficients are odd and purely imaginary, while the Fourier series contains only 
sine functions. ^ 

EXERCISES 

The periodic function / with period 4 is given by /(f) = 1 + | f | for | f | < 1 and 
/(f) = 0 for 1 < | f | <2. Sketch the graph of the function and determine its 
Fourier coefficients. 

Determine the Fourier coefficients of the periodic function with period T defined by 
/(f) = f on the interval (0, T). 

Let the complex-valued function /(f) = u(t) + zv(f) be given, where u(t) and v(f) 
are real functions with Fourier coefficients u n and v n . 
a Determine the Fourier coefficients of /(f) and of /(f). 

b Suppose that /(f) is even, but not real. Will the Fourier coefficients of /(f) be 
even and real then? 

The amplitude spectrum of a function does not change when a shift in time is 
applied. For which shifts does the phase spectrum remains unchanged as well? 

In section 3.5.4 we derived that for even functions the ordinary Fourier series con¬ 
tains only cosine terms. Show that this also follows directly from (3.5) and (3.6). 


3.6 Fourier cosine and Fourier sine series 

In section 3.5.4 we showed that the ordinary Fourier series of an even periodic func¬ 
tion contains only cosine terms and that the Fourier series of an odd periodic func¬ 
tion contains only sine terms. For the standard functions we have seen that the pe¬ 
riodic block function and the periodic triangle function, which are even, do indeed 
contain cosine terms only and that the sawtooth function, which is odd, contains 
sine terms only. Sometimes it is desirable to obtain for an arbitrary’ function on the 
interval (0, T) a Fourier series containing only sine terms or containing only cosine 
Fourier sine series terms. Such series are called Fourier sine series and Fourier cosine series. In order 

Fourier cosine series to find a Fourier cosine series for a function defined on the interval (0. T), we extend 

the function to an even function on the interval (— T, T ) by defining /(—f) = /(f) 
for — T < t < 0 and subsequently extending the function periodically with period 
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Forced series development 

EXAMPLE 


EXAMPLE 


2 T. The function thus created is now an even function and its ordinary Fourier series 
will contain only cosine terms, while the function is equal to the original function 
on the interval (0, T). 

In a similar way one can construct a Fourier sine series for a function by extending 
the function defined on the interval (0, T) to an odd function on the interval (-T, T) 
and subsequently extending it periodically with period 2 T. Such an odd function 
will have an ordinary Fourier series containing only sine terms. 

Determining a Fourier sine series or a Fourier cosine series in the way described 
above is sometimes called a forced series development. 

Let the function f(t) be given by f(t) = t 2 on the interval (0, 1). We wish to obtain 
a Fourier sine series for this function. We then first extend it to an odd function 
on the interval (—1, 1) and subsequently extend it periodically with period 2. The 
function and its odd and periodic extension are drawn in figure 3.13. The ordinary 



FIGURE 3.13 

The function /(f) = f 2 on the interval (0, 1) and its odd and periodic extension. 


Fourier coefficients of the function thus created can be calculated using (3.5) and 
(3.6). Since the function is odd, all coefficients a„ will equal 0. For b n we have 


bn — 


2 r T / 2 


i 


T J-T/2 

2 • 

t~ sinnnt dt. 


/: 


f(t) sinncoQt dt = I (—t“) sinnnt dt + / t~ sinnnt dt 


f, 


= 2 f 


Applying integration by parts twice, it follows that 


-2 

ifi i 1 


f cos nnt 

nn 

| L Jo 

2 | 

( 2(cos/?7r — 1) 

nn ’ 

l n 2 n 2 


2 

0 tlTZ 

— cos mt I = 


J 0 2 2 


[cosnjrf],!, 


\ = 2 / 2((—1)” 
) nn \ n 2 jt 2 


1) 


- (- 1 / 


The Fourier sine series of /(f) = f 2 on the interval (0, 1) is thus equal to 


E 

n= 1 


2 / 2 ((— 1 )” — 1 ) 


— (— 1)" ) sinnnt. 


In this final example we will show that one can even obtain a Fourier cosine series 
for the sine function on the interval (0, n). To this end we first extend sinf to an 
even function on the interval (—n, n) and then extend it periodically with period 
2 n; see figure 3.14. The ordinary Fourier coefficients of the function thus created 
can be calculated using (3.5) and (3.6). Since the function is even, all coefficients 
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FIGURE 3.14 

The even and periodic extension of the function /(f) = sinf on the interval (0, n). 


b„ will be 0. For a„ one has 
T/2 


2 

a n — 777 


T J- 


L 


T/2 


fit) cos niDQt dt 


r ■ 

■ I sir 

Jo 


(— sinf) cos nt dt + / sin t cos nt dt 


r . 

I sir 

Jo 


= — I sinf cos nt dt. 
n 


Applying the trigonometric formula sinf cos nt = (sin(l + n)f + sin(l —n)t)/2 then 
gives for a n with « / 1: 


1 C n 
It Jo 


a n = — / (sin(l + n)t + sin(l — n)f) dt 


M — 

7t ll + n 


cos(l + n)t + 


-1 


1 /!-(-! ) n 

71 


1+17 


+ 


1—11 

1 ~ (-D 
1—11 


cos(l — n)t 


2(1 — (— 1 )” 1 ) 

jr(l — ii 2 ) 


It is easy to check that oq = 4/ir and a\ = 0. The Fourier cosine series of the 
function /(f) = sin f on the interval (0, tc ) is thus equal to 


2 ^2, 2(1 - (—l)" -1 ) 




jr( 1 — n 1 ) 
«=2 ' 


■ COS Ilf. 


3.19 


3.20 

3.21 

3.22 


EXERCISES 


Determine the Fourier sine series and the Fourier cosine series on (0, 4) for the 
function /(f) given for 0 < f < 4 by 


/(f) = 


f for 0 < f < 2, 
2 for 2 < f < 4. 


Determine a Fourier sine series of cos f on the interval (0, ir). 

Determine a Fourier sine series and a Fourier cosine series of the function /(f) = 
f(f — 4) on the interval (0, 4). 

Determine a Fourier sine series of the function /(f ) defined on the interval (0, T/2) 
by/(f) = 1/2 for 0< f < T/2. 
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3.23 

3.24 


SUMMARY 


Trigonometric polynomials and series are, respectively, finite and infinite linear 
combinations of the functions cosncoQt and sin/ift>o f with n e N. They are all 
periodic with period T = 2n/a)Q. When a trigonometric polynomial /(f) is given, 
the coefficients in the linear combination can be calculated using the formulas 

2 f T / 2 

a n = — I /(f) cosncoot dt for n = 0, 1, 2, ..., 

T J-t/2 

2 f T / 2 

b n — I /(f) sinna>of dt forn = 1 , 2 ,. ... 

T J-T/2 

These formulas can be applied to any arbitrary periodic function, provided that the 
integrals exist. The numbers a n and b n are called the Fourier coefficients of the func¬ 
tion f(t). Using these coefficients one can then form a Fourier series of the func¬ 
tion /(f): 


«o 

2 


oo 

+ J2 (an cosncoQt + b n sinncuof). 

77 = 1 


Instead of a Fourier series with functions cosncoQt and sin na>Qt one can also obtain 
a complex Fourier series with the time-harmonic functions e" ,a> ° r . The complex 
Fourier coefficients can then be calculated using 

i r T/2 _• 7 

c n = — I /(f)e lnc0( F dt for n e Z, 

T J-T/2 

while the complex Fourier series has the form 


oo 

J2 c n e ina)ot . 

77= —OO 


These two Fourier series can immediately be converted into each other and, depend¬ 
ing on the application, one may chose either one of these forms. 

The sequence of Fourier coefficients ( c n ) is called the spectrum of the func¬ 
tion. This is usually split into the amplitude spectrum | c n | and the phase spectrum 
arg(c„). 

For some standard functions the Fourier coefficients have been determined. More¬ 
over, a number of properties were derived making it possible to find the Fourier 
coefficients for far more functions and in a much simpler way than by a direct 
calculation. 

Even functions have Fourier series containing cosine terms only. Series like this 
are called Fourier cosine series. Odd functions have Fourier sine series. When 
desired, one can extend a function, given on a certain interval, in an even or an odd 
way, so that they can be forced into a Fourier cosine or a Fourier sine series. 


SELFTEST 

The function /(f) is periodic with period 10 and is drawn on the interval (—5, 5) in 
figure 3.15. Determine the ordinary and complex Fourier coefficients of /. 

Show that when for a real function / the complex Fourier coefficients are real, / 
has to be even, and when the complex Fourier coefficients are purely imaginary, / 
has to be odd. 
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FIGURE 3.15 

The periodic function f(t) from exercise 3.23. 


3.25 


3.26 


3.27 


Determine the Fourier series of the periodic function /(f) with period T , when for 
— T/2<t < 7/2 the function /(f) is given by 


/(f) = 


0 for -T/2 <t <0, 

sin coot for 0 < f < T/2. 


Calculate and sketch the amplitude and phase spectrum of the periodic function 
/(f), when /(f) has period 2n and is given for — n < t < n by 


/(f) = 


0 for — n < t < 0, 
f for 0 < f < n. 


Consider the function /(f) defined by: 


/(f) = 


2b 

— f 
a 


for 0 < f < -, 
2 


26 a 

— (a — t) for — < t < a. 

'-a 2 

a Sketch the graph of /(f), of its odd and of its even periodic extension, 
b Give a development of /(f) on (0, a) as a Fourier cosine series and also as a 
Fourier sine series. 
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CHAPTER 4 


The fundamental theorem of Fourier 
series 


INTRODUCTION 


Chapter 3 has been a first introduction to Fourier series. These series can be associ¬ 
ated with periodic functions. We also noted in chapter 3 that if the function satisfies 
certain conditions, the Fourier series converges to the periodic function. What these 
specific conditions should be has not been analysed in chapter 3. The conditions that 
will be imposed in this book imply that the function should be piecewise smooth. In 
this chapter we will prove that a Fourier series of a piecewise smooth periodic func¬ 
tion converges pointwise to the periodic function. We stress here that this condition 
is sufficient: when it holds, the series is pointwise convergent. This condition does 
not cover all cases of pointwise convergence and is thus not necessary for conver¬ 
gence. 

In the first section of this chapter we derive a number of properties of Fourier co¬ 
efficients that will be useful in the second section, where we prove the fundamental 
theorem. In the fundamental theorem we prove that for a piecewise smooth periodic 
function the Fourier series converges to the function. In the third section we then 
derive some further properties of Fourier series: product and convolution, Parseval’s 
theorem (which has applications in the analysis of systems and signals), and inte¬ 
gration and differentiation of Fourier series. We end this chapter with the treatment 
of Gibbs’ phenomenon, which describes the convergence behaviour of the Fourier 
series at a jump discontinuity. This is then also an appropriate occasion to introduce 
the function Si(x), the sine integral. This function will re-appear in other chapters 
as well. 

LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- can formulate Bessel’s inequality and the Riemann-Lebesgue lemma 

- can formulate and apply the fundamental theorem of Fourier series 

- can calculate the sum of a number of special series using the fundamental theorem 

- can determine the Fourier series of the product and the convolution of two periodic 
functions 

- can formulate and apply Parseval's theorem 

- can integrate and differentiate Fourier series 

- know the definition of the sine integral and know its limit 

- can explain Gibbs’ phenomenon*. 


4.1 Bessel’s inequality and Riemann-Lebesgue lemma 

In chapter 3 we always assumed in the definition of the Fourier coefficients that 
the integrals, necessary for the calculation of the coefficients, existed. As such. 
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THEOREM 4.1 

Bessel’s inequality 


this is not a very important problem: if the integrals do not exist, then the Fourier 
coefficients do not exist and a further Fourier analysis is then impossible. In this 
chapter we confine ourselves to piecewise continuous periodic functions and for 
these it is easy to verify that the Fourier coefficients exist; see section 2.3. 

As soon as the Fourier coefficients of a periodic function exist, it is, however, by 
no means obvious that the Fourier series converges to the function. In this chapter 
we will present conditions under which convergence is assured. 

In the present section we will first treat some properties of the Fourier coefficients 
that will be needed later on. First we show that the sum of the squares of the Fourier 
coefficients of a piecewise continuous function is finite. This is called Bessel’s 
inequality. Next we show that the Fourier coefficients c„ of a piecewise continuous 
function tend to 0 as n -*■ ±oo. This is called the Riemann-Lebesgue lemma and 
is needed in the next section to prove the fundamental theorem of Fourier series. 


When c n are the Fourier coefficients of a piecewise continuous periodic function 
f(t) with period T, then 


T. i c » 


, 1 f T/2 

~ T J-t /2 


I fit) | 2 


dt. 


(4.1) 


Proof 

In the proof we use the partial sums of the Fourier series of f(t) with Fourier coef¬ 
ficients C£. We denote these by s n (t), so 

Sn(t) = J2 C k eikm ‘’ (42) 

k——n 


For a fixed value of n with —n<k<n we now calculate 

r-T/2 

T J-T/2 


1 f 1 / Z 

- {f(t)-s n (t))e- ik ^t dt 

1 J-T/2 

i r T / 2 


s: 


, f(t)e~ ikm °’dt - - 
T J-T/2 T 


1 


n r T/2 

itfJn J ~ T / 2 


e i(l-k) m t dt 


The first integral in the right-hand side is precisely the definition of the Fourier 
coefficient c&. The integrals in the sum in the right-hand side are all equal to 0 for 
l fz k. When l = k, the integrand is 1 and the integral T , so ultimately the sum 
equals eg. We thus have 

1 f 7 ’/ 2 

- / (fit) - s n(t)> e~ lka>0 ' dt = c k - c k = 0 for -n < k < n. 

1 J-T/2 

Using this result we calculate the following integral: 



(fit) - s„(t)) s n (t) dt 


n *T/2 

Y^ck (f(t)~ s n ( 0 ) e~ lkL °tt' dt = 0 . 

k=-n J ~T /2 


If we now multiply f{t) — s n (t) in the integral in the left-hand side not by s n ( t ), but 
by fit) ~ s n (t), it follows that 


rT/2 

J-T/2 


(fit) ~ s,i(t)) (fit) - s n (t))dt = 


/. 


T/2 


-T/2 


(fit) ~ S„(t)) f (t) dt 


-i 


T/2 

T/2 


f(t)f(t)dt- 


,T/2 

J-T/2 


Sn(t)f(t)dt 
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THEOREM 4.2 

Riemann-Lebesgue lemma 


EXAMPLE 


rT /2 

1/(0 

J-T/2 


rT/2 

1/(0 

J-T/2 


rT /2 

1/(0 

J-T/2 



\ 2 dt 
| 2 dt 
I 2 dt 


n r T/2 

£ c* / e ,k(oot f{t) dt 

k=—n J ~ T r- 


n r.T/2 

£ c k e ~ ik( °o>f(t)dt 

k=—n J - T / 2 

n pT/2 n 

J2 c k T <*= \f{t)\ 2 dt-T £ \c k \ 2 . 

k=—n J—T/2 k——n 


The first term in this series of equalities is greater than or equal to 0, since 
if it) — s n (t)) {fit) — s n {t )) = | f(t) — Sn(t) \ 2 > 0. The last term must then 
also be greater than or equal to 0, which means that 

n pT/2 

T £ \c k \ 2 < / I fit) I 2 dt. 

k=—n 2-772 


This inequality holds for any n e N, while the right-hand side is independent of n. 
One thus has 


£ 1 c » 1 2 = 


lim £ 

l —>00 L -' 

k=—n 


\c k \ 2 < 


fl 


T/2 


T/2 


I f(t)\ 2 dt. 


If f{t) is a piecewise continuous function, then | /(f) \ 2 is one as well, and so 
the right-hand side of inequality (4.1) is finite. In particular it then follows that the 
series YlnJ=—oo I Cn I 2 converges. Hence, we must have c n —> 0 as n —> ± 00 . This 
result is known as the Riemann-Lebesgue lemma. 

If f{t) is a piecewise continuous periodic function with Fourier coefficients c n , then 
lim c„ — lim c n = 0. (4.3) 

11 —>-00 tl —> — 00 

Theorem 4.2 can be interpreted as follows. In order to calculate the coefficients 
c n , the function f(t) is multiplied by e~ ln(oot and integrated over one period. For 
increasing n, the frequency of the corresponding sine and cosine functions keeps 
increasing. Now consider two consecutive intervals such that, for example, the sine 
function is negative in the first interval and positive in the second. For increasing 
n, and hence for ever smaller intervals, the value of / in the first and in the second 
interval will differ less and less. Multiplied by first a negative and then a positive 
sine function, the contributions to the integral will cancel each other better and better 
for increasing n. In this way the coefficients will eventually converge to 0. 

The periodic block function, introduced in section 3.4.1, is piecewise continuous. 
The Fourier coefficients, which have also been calculated there, are equal to 
2 smimoQa/2)/ Tna>Q. The numerator ranges for increasing n between —1 and 1, 
while the denominator tends to infinity as n -¥ 00 . For the Fourier coefficients we 
thus have 

2 sin(«<y 0 a/2) 

lint-= 0. 

h—» oo T na>Q 

The Fourier coefficients of the periodic block function thus tend to 0 as n -»■ 00 . 
Similarly one can check that the same is true for the Fourier coefficients of the 
periodic triangle function and the sawtooth function from sections 3.4.2 
and 3.4.3. 


◄ 



4.2 The fundamental theorem 


DEFINITION 4.1 

Dirichlet kernel 


EXERCISES 

4.1 a Check for the periodic block function and the periodic triangle function from 
section 3.4 whether or not they are piecewise smooth and whether or not the Fourier 
coefficients c„ exist. 

b Show for the functions from part a that YlnL—oo I Cn I 2 * s conver g ent - 

4.2 The ordinary Fourier coefficients of a piecewise continuous periodic function are a n 
and b n (see definition 3.1). 

a Prove that lim„^oo a n = lim„^.oo b n = 0. To do so, start from theorem 4.2. 
b Now assume that hin^^oo a n = lim^-^oo b n = 0. Use this to prove that 
linw±oo c„ = 0. 

4.3 Check that the Fourier coefficients c n of the periodic sawtooth function tend to 0 as 
n -* oo, in accordance with the Riemann-Lebesgue lemma. 


4.2 The fundamental theorem 

In chapter 3 we have noted more than once that at the points of continuity, the 
Fourier series of a piecewise smooth periodic function is equal to that function. This 
statement, formulated in the fundamental theorem of Fourier series, will be proven 
in this section. This will involve pointwise convergence. Before we go into this, we 
first introduce the so-called Dirichlet kernel. This is a function that will be needed 
in the proof of the fundamental theorem. We will also deduce some properties of 
the Dirichlet kernel. 

The Dirichlet kernel D n (x) is defined by 
n 

D n (x ) = ^ e —ik(OQX _ g ina>QX g i(n-\)a> 0 x g i(n-2)w 0 x _|__|_ g -ino) 0 x 

k=—n 

The Dirichlet kernel is a periodic function, which can be considered as a geo¬ 
metric series with 2 n + 1 terms, starting with e mc0 ° x and having ratio e~ ,<0 ° x . In 
example 2.16 the sum of a geometric series was determined. From this it follows 
that for e~ lco ° x 1 one has that 


D„(x) = 


e imoox^ _ g —i(oo(2n+l)x\ 
1 _ e -iw 0 x 


(4.4) 


Performing the multiplication in the numerator and multiplying numerator and de¬ 
nominator by e ia>ox ^, it follows upon using (2.11) that 


D„(x) = 


g i(n + l/2)a>ox _ g -i(n+l/2)a>ox 
e icoox/2 _ g -ia>ox/2 


sin((/7 + \/2)coqx) 
sin(a>ox/2) 


(4.5) 


The above is valid for e~ lm ° x 1, that is to say, for coqx k ■ 2tt, or x k-T with 
k e Z. If, however, we do have x = k ■ T , then e~ ilca>oX = e~ ik 2?r = 1. From the 
definition of the Dirichlet kernel it then immediately follows that D n (k -T) = 2/7 + 1 
for JreZ. Furthermore, it is easy to see that the Dirichlet kernel is an even function. 
In figure 4.1 the graph of the Dirichlet kernel is sketched for n = 6. When n 
increases, the number of oscillations per period increases. The peaks at the points 
x = kT continue to exist and increase in value. 
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FIGURE 4.1 

The Dirichlet kernel for n = 6. 


THEOREM 4.3 
Fundamental theorem of 
Fourier series 


The integral of D n (x) over one period is independent of n. In fact, since 
dx — 0 for k 0, it follows that 


fT / 2 —ikojQX 

J-T/2 e 


l 


t/2 


-T/2 


D n (x) dx = 


£ T/2 

k=—n 4 —T/2 


e -ik(OQX dx= \ dx = T. 


L 


— T/2 


(4.6) 


Since D„ (x) is an even function, it moreover follows that 

f 


■ T/2 T 

D n (x) dx = —. 


(4.7) 


We have now established enough properties of the Dirichlet kernel to enable us 
to formulate and prove the fundamental theorem. According to the fundamental 
theorem, the Fourier series converges to the function at each point of continuity of a 
piecewise smooth periodic function. At a point where the function is discontinuous, 
the Fourier series converges to the average of the left- and right-hand limits at that 
point. Hence, both at the points of continuity and at the points of discontinuity the 
series converges to (/(r+) + f(t—))/2. The fundamental theorem now reads as 
follows. 


Let f(t) be a piecewise smooth periodic function on R with Fourier coefficients c n . 
Then one has for any t e R: 


OO i 

Y, c n e incuo ' = -(/(f+) + /(r-)). 


Proof 

For the proof of this theorem we start from the partial sums s n ( t ) of the Fourier series 
as defined in (4.2). Replacing c^ by the integral defining the Fourier coefficients we 
obtain 

n n / 1 r T/2 \ 

Sn(t) = £ c k e ik ^= £ - f(u)e~ ikm °“ du )e ik ^ 

k=—n kt^nV J ~T/2 ) 

i r 7 '/ 2 n 

= T / m £ e- ika »< u ~'Uu. 

1 J-T/2 k= _ n 
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Interchanging the order of integration and summation is allowed here, since the sum 
contains a finite number of terms. Substitution of u — t — x then gives 


SnU) = 


i rT/2-t n 

- f(x + t) J2 e ~ ik0>OX dx 

1 J-T/2-t k= _ n 


i r T r- 

— / /ix + t)D n (x) dx. 

I J-T/2 


(4.8) 


We are allowed to change the integration interval in the last step, since the integrand 
is periodic with period T. In the last step we also introduced the Dirichlet kernel. 
If we take the limit n -*■ oo in (4.8), then s n (t) will become the Fourier series of 
fit). Hence, if we can show that the final term in (4.8) converges to (/(f+) + 
fit—))/ 2, then we’ve completed the proof. If we assume for the moment that / 
is continuous at t, then it is plausible that this final term will indeed be equal to 
f(t). For, according to (4.6) one has f_ jn Hnix) dx = T. Moreover, D n { 0) 
keeps increasing for increasing n, while for x 0 the oscillations of D n (x) become 
more frequent. Since eventually f(x + t) will vary less rapidly, the consecutive 
oscillations of f (x + t)D n (x) will cancel each other more and more, and hence 
only the value of fix + t) for x = 0, so fit), will remain. To prove this, we will 
now first of all split the integration interval {—T /2, T /2) in two parts and replace 


the variable j 

rby- 

-x on i~T/ 2, 0). Since D, 

, ix) is even, it then follows 

1 


1 

[T/2 

Sn(t) = — 


fit +x)D„ix)dx + — 1 

1 f(t+x)D n ix)dx 

0 

T J 

-T/2 

T J 

1 

fT/2 

1 

[T/2 

= T J 

l 

fit - x)D n i-x)dx + — 

/ fit + x)D n ix)dx 

Jo 

1 

[T/2 



= T J 

( 

ifit + x) + fit -x)) D n 

ix) dx. 


We now subtract fit+)+fit —) from the factor fit+x) + fit—x) in the integrand. 
In order not to change s n it), we have to add this term as well, which will be done in 
a separate integral. We then get: 


Suit) = -L f ifit+x)-fit+) + fit-x)-fit-))D n ix)dx 
T Jo 

+ xx f ifit+) + fit-))D„ix)dx. 

T Jo 

According to (4.7), the second term equals (/(f+) + fit—))/2. The first term will 
be called I n it). If we can show that this term tends to 0 as n —>■ oo, then we have 
finished the proof. To this end we use (4.5) to write I„ it) as 


Init) 


1 f T/2 fit + x)-fit+) +fit-x)-fit-) xsm((n+ \)(o 0 x) 


L 


T Jo -* 

i [ T r- , 

= — / 2(x)sm((n + 1 )o>qx) dx. 

T Jo 

Here Qix) is given by 

, fit + *) - fit+) + fit -x)- fit-) 

Qix) =- 


sin(coo-v/2) 


dx 


(4.9) 


sin(a>o-*/2) 
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For x = 0 the integrand of I n (t) is not defined, since then the denominator of 
Q(x ) equals 0. However, since /(f) is a piecewise smooth function, the limits for 
x —> 0 of {fit + x) — f(t+))/x and (/(f — x) — f(t—))/x, which occur in Q(x), 
do exist according to theorem 2.4, and they equal f'(t+) and f'(t—) respectively. 
Since the limit for x —> 0 of x/ sin(a>ox/2) exists as well, it follows that Q(x) is a 
piecewise continuous function. Furthermore, we note that Q{x) is odd. And since 
sin((n + \)o>qx) is also odd, the integrand in (4.9) is an even function. We can 
therefore extend the integration interval to \—T/ 2, T/ 2\. Using the trigonometric 
identity sinCa + /) = sin a cos f + cos a sin f we then obtain: 

i [ T r- 

ln(t) = — / Q(x)sm((n+ 1 )wox)dx 
2T J-T/2 

1 f 7 ' 2 / . N 

= — 1 Q(x)( sm{na>Qx) cos(a> 0 */2) + cos{na> 0 x) sin(&) 0 x/2) )dx 

2T J-T/2 v ’ 

1 2 [ T r- 

= - • — / Q(x) cos(w 0 x/2) sm{na)Qx) dx 
4 T J-T/2 

1 2 [ T / 2 

-\—■ / Q(x) sin(a>o-v/2) cos(n&>ox) dx. 

4 T J-T/2 

The two integrals in the final expression are precisely the formulas for the 
ordinary Fourier coefficients of the function Q(x) cos{cl>qx/2) and the function 
Q{x) sin(cno-X'/2); see definition 3.1. Since Q(x) is piecewise continuous, so are 
the functions Q(x) cos{cl>qx/2) and Q(x) smltno*^), and hence one can apply the 
Riemann-Lebesgue lemma from theorem 4.2. We then see that indeed /„ (f) tends 
to 0 as n —> oo. This completes the proof. g 


Having established the fundamental theorem, it is now a proven fact that Fourier 
series of piecewise smooth functions converge. At the points of continuity of the 
function, the Fourier series converges to the function value and at the points of dis¬ 
continuity to the average of the left- and right-hand limits (/(f+) + /(f—))/2. For 
example, the Fourier series of the periodic block function from section 3.4.1 will 
converge to the function with graph given by figure 4.2. At the points of discontinu¬ 
ity the function value is 1/2. 



FIGURE 4.2 

Limit of the Fourier series of the periodic block function. 

From the fundamental theorem it immediately follows that if two periodic func¬ 
tions have the same Fourier series, then these functions must be equal at all points 
of continuity. Moreover, it follows from the definition of the Fourier coefficients 
that the values of the functions at the points of discontinuity have no influence on 
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THEOREM 4.4 

Uniqueness theorem 


THEOREM 4.5 


the coefficients. This is precisely the reason why we didn’t pay any attention to the 
values of functions at the points of discontinuity in chapter 3. In the end, the Fourier 
series will always converge to the average of the left- and right-hand limit. Apart 
from the points of discontinuity, functions with equal Fourier series are the same. 
We formulate this result in the following uniqueness theorem. 

Let fit ) and git) be piecewise smooth periodic functions with Fourier coefficients 
f n and g n . If f n — gn f or oil n e Z, then fit) = git) at all points where f and g 
are continuous. 

From the fundamental theorem it follows that the Fourier series of a function con¬ 
verges pointwise to the function at the points of continuity. Some general remarks 
can be made about the rate of convergence. If we compare the Fourier coefficients of 
the periodic block function and the periodic triangle function from sections 3.4.1 and 
3.4.2, then we observe that the coefficients of the discontinuous block function de¬ 
crease proportional to 1/n, while the coefficients of the continuous triangle function 
decrease proportional to 1/n 2 . The feature that Fourier coefficients of continuous 
functions decrease more rapidly compared to discontinuous functions is true in gen¬ 
eral. If the derivative is continuous as well, then the Fourier coefficients decrease 
even more rapidly. As higher derivatives are continuous as well, the Fourier coef¬ 
ficients decrease ever more rapidly. Hence, the smoother the function, the smaller 
the contribution of high frequency components in the Fourier series. We summarize 
this in the following statements. 

a If the function fit) is piecewise continuous, then the Fourier coefficients tend 
to zero (this is the Riemann-Febesgue lemma). 

b If fit) is continuous and f'(t) piecewise continuous, then the Fourier coeffi¬ 
cients decrease as 1/n, so limH-^-i-oo nc n = 0. 

c If fit) and its derivatives up to the ik — l)th order are continuous and /®(f) 
is piecewise continuous, then the Fourier coefficients decrease as 1/n*, so 
lini/i->.±oo n k c„ = 0. 

These statements will not be proven here (but see the remarks following theorem 
4.10). From these statements it follows that in comparison to smooth functions, for 
less smooth functions one needs more terms from the series in order to achieve the 
same degree of accuracy. The statements also hold in the opposite direction: the 
faster the Fourier coefficients decrease, the smoother the function. An example is 
the following result, which will be used in chapter 7 and is stated without proof here. 

Let a sequence of numbers c n be given for which Yln =—oo I c n I < Then the 
series Yl'nL-o o c n e lnc0ot converges to the continuous function fit) having Fourier 
coefficients c n . 

For functions with discontinuities it is the case that - no matter how many terms 
one includes - in a small neighbourhood left and right of a discontinuity, any ap¬ 
proximation will ‘overshoot’ the function value on one side and 'undershoot’ the 
function value on the other side. It is even the case that the values of these overshoots 
are & fixed percentage of the difference | fit+) — fit—) |. These overshoots do get 
closer and closer to the point of discontinuity, as more terms are being included. 
This curious phenomenon is called Gibbs’ phenomenon and will be discussed in 
section 4.4.2. 

An important side result of the fundamental theorem is the fact that sums can be 
calculated for many of the series for which, up till now, we could only establish the 
convergence using the tests from chapter 2. Below we present some examples of 
such calculations. 
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4 The fundamental theorem of Fourier series 


EXAMPLE 4.1 


EXAMPLE 4.2 


4.4 

4.5 


Consider the periodic triangle function q a j for a — T/ 2, whose Fourier coeffi¬ 
cients have been calculated in section 3.4.2: c n = 2 sin 2 (nn/2)/n 2 n~ for n / 0 
and cq = 1 /2. For even n and n ^ 0 the Fourier coefficients are thus all zero. For 
odd n they equal 2 //i 2 7 r 2 . Since the periodic triangle function is a continuous piece- 
wise smooth function, we may apply the fundamental theorem of Fourier series and 
thus one has for all t : 


< 7772 ,r( 0 = 22 c„t 


1 °° O 

,incoot _ _ \ A ___ e i{2n—\)o)Qt 

2 n^o o - D 2 ^ 2 


In particular this equality holds for t = 0. The triangle function then has value 1, 
while e ! '( 2 ”—l)®o t equals 1 as well. Hence, 



00 

+ E 

n=—o o 


2 

{In — 1) 2 7T 2 


1 00 

+ E 


n =1 


4 

(2n — 1 ) 2 7 t 2 


Now take 1/2 to the other side of the equality-sign and multiply left and right by 
7 T 2 / 4 , then 


00 


E 


1 

(2 n - l) 2 




+ 



(4.10) 

◄ 


The sawtooth function 2r/ 7\ as defined in section 3.4.3, is a piecewise smooth func¬ 
tion having Fourier coefficients i (— 1)" / Tin for n^O and eg = 0. The fundamental 
theorem is applicable and for —T/2<t < T/2 one has 


r. 00 00 

y = J2 c n e huoot - 22 (cr,e in(O0t + 


n=—o o 
oo 


n =1 


- E M" 


n= 1 
oo 


+ (-l)'"-c 

—Tin 


— • / inojQt _ -ina) 0 t \ 00 _2 

= E(-D "— 2i (- T- -) = E(-D"— sin ncoQt. 

L —i Tin \ 2 1 z —\ nn 

n= 1 \ / n =1 


This equality holds in particular for t = T/4. For this value of t one has that 
sin ncoQt = sin(nTi/2). This equals 0 for even n, so 


, oo 

i = E<-D 2 "-' 


-2 


n=l 


jt{2n — 1) 


. (2 n — 1)tt A 2 

sin- = > - 

2 n{2n — 1) 

n =1 


(-i) 


n — 1 


If we multiply this by jr/2, then we obtain 

oo 
7T 

E _ 


IT ^ (- 1 )"“' 


1 1 1 

4 2/7-1 ~ _ 3 + 5 _ 7 + ' 

72=1 


(4.11) 

■4 


EXERCISES 

Calculate the sum of the Fourier series of the sawtooth function at a point of discon¬ 
tinuity and use this to verify the fundamental theorem at that point. 

Let f(t) be an odd piecewise smooth periodic function with period T. Show that 

oo 

22 b n sim/togt = + /(/-)). 

n =1 
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4.6 


4.7 


4.8 


4.9 


a Determine the Fourier series of the periodic function /(f) with period 2 n de¬ 
fined for —jt < t < n by 


m = 


0 for — n < t < 0. 
1 for 0 < t < n. 


b Verify that /(f) satisfies the conditions of the fundamental theorem. Then take 
r = ?r/2 and use this to derive (4.11) again. 

a Determine the Fourier series of the periodic function /(f) with period 2n de¬ 
fined for — n < t < n by 


/(*) = 


0 for —n < f < 0, 
f for 0 < f < 7t. 


b To which value does the Fourier series converge at f = n according to the 
fundamental theorem? Use this to derive (4.10) again. 

Let /(f) be the periodic function with period 1 defined for —1/2 < f < 1/2 by 
/(f) = f 2 . 

a Verify that / is continuous and that f' is piecewise continuous. Determine the 
Fourier coefficients and check that these decrease as 1 /n 2 . 
b Apply the fundamental theorem at f = 0 in order to derive that 


oo 


E 


(-i) n+i 


111 _ 7t l 

4 + 9 _ l6 + "' _ T2' 


Show that 


^ 2 , 1 111 
?^- 1 + 4 + 9 + l 6 + - 


n= 1 


7V 

~6 


Let /(f) be the periodic function with period 2 defined for — 1 < f < 1 by 


m = 


t 2 + f for — 1 < f < 0, 
-f 2 + f forO < f < 1. 


a Verify that / and f' are continuous, while f" is discontinuous, 
b Determine the Fourier coefficients and check that these decrease as 1/n 2 . 
c Show that 

(- 1 )” 11 = JT^ 

,^ 0 (2 n + l) 3 ! 27 + 125 " 32 ' 


4.3 Further properties of Fourier series 

Now that we have proven, in the fundamental theorem of Fourier series, that for 
piecewise smooth functions the Fourier series converges to the function, one can 
derive some additional properties. These are properties of Fourier series with respect 
to products and convolutions of functions, the Parseval identity, and the integration 
and differentiation of Fourier series. 
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THEOREM 4.6 

Fourier series of a product of 
functions 


EXAMPLE 4.3 


4.3.1 Product and convolution 


In this section we consider the relations that emerge when functions are multiplied, 
or when Fourier coefficients are multiplied. First we consider how one can deter¬ 
mine the Fourier coefficients of a function which is the product of two functions. 

Let /(f) and g(t ) be piecewise smooth periodic functions with Fourier coefficients 
f n and g n . When h(t ) = f(jt)g(t), then h(t) has a convergent Fourier series with 
Fourier coefficients h n given by 
oo 

hn= J2 fk-Sn-k • (4-12) 

*=—oo 


Proof 

Since /(f) and g(t) are piecewise smooth periodic functions, so is h(t) and thus it 
has a convergent Fourier series. According to definition 3.3 one has for the coeffi¬ 
cients h n : 

1 r T / 2 ■ , 

K = ~ f (t)g(t)e~ lncoot dt. 

1 J-T/2 

Since /(f) is a piecewise smooth periodic function, one can, according to the funda¬ 
mental theorem, replace /(f) by its Fourier series at all points of continuity. Since 
we are integrating, the value at the points of discontinuity are of no importance. 
Hence 

i pT/2 oo 

K = - / V fi i e ik( °° t g(t)e~ incoot dt. 

T J-T/2 k^oo 


Under the conditions of the theorem, one may interchange the order of integration 
and summation. Using the definition of the (n — fc)th Fourier coefficient of g{t) it 
then follows that 


oo j pT/2 

hn = E fkft 

' T J-T/2 


k=—oo 


-T/2 


g(t)e 


—i (n—k)a>ot _ 


dt — y , fk ’ gn-k- 


k=—o o 


Consider the periodic functions /, g and h with period 2 defined on the interval 
(—1, 1) by /(f) = g(t) = f and h(t) = f 2 . In exercise 3.9 it was deduced that the 
Fourier coefficients /„, g„ and h n of these functions are given by 


fn — gn — 


hn — 


— (-1)" for n / 0, 
nn 

0 for n = 0, 

2(-l)" 


2tt2 


iFn 

1 


for n 0, 


for n — 0. 


Since the functions are piecewise smooth and h(t) = /(f)g(f), one can also obtain 
the coefficients of /7(f) from f, and g n using theorem 4.6. We first calculate 1iq. 


/7 0 = £ /*■«-* = 2 £^(-i)* 

*=-00 k=l 


—kn 


(- 1 ) 


-k 


2 n 2 1 
7T 2 6 3 


oo 


E 


1 

*2 
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DEFINITION 4.2 

Convolution of periodic 
functions 


Here we used the result l/£ 2 = 7r 2 /6 from exercise 4.8c. We now calculate 

h n . 


hn — y ' fk ' Sn—k — ^ ' 

k=—oo 


— (—!)" 


■ E 

k =—oo 
kf:0,kf:n 


k=—o o 
kjtO.kjtn 

1 

(n — &)£ 


i i- i 

— (-ir- 

kn (n — k)n 


(- 1 ) 


n—k 


This last sum is somewhat difficult to calculate. Using a partial fraction expansion 
it follows that 


E 


i 


k=—oo 

kf$),kf-n 


(n — k)k 


1 v (- — 

n • ^ \ k n — 


k =—OO 

k^0,k^n 

/ 


n — k 


\ 


_ 1 y, 1 

k=—o o , 

kf 0 / 


/ 


1 ^ 1 

-f -r 

n , L —' n — k 
k=—o o 


\ 


) 


Since the sums in the right-hand side always contain terms having opposite signs, 
these terms will all cancel each other and so these sums are 0, implying that 


E 


i 


k=—o o 
kf:0,kf:n 


(n — k)k 


„2 ‘ 


For h n it now follows that 

— (—!)" -2 2(—1)” 


hf t — 


Hence, the expressions for 1iq and h n , calculated using theorem 4.6, coincide with 
the direct calculation of the Fourier coefficients in exercise 3.9. ^ 


We have seen that the Fourier coefficients of the product of two functions can be 
calculated using the Fourier coefficients of the individual functions. To do so, one 
has to form a sum of products of the Fourier coefficients. Another nice relationship 
arises if we examine what kind of functions emerge if we multiply the Fourier co¬ 
efficients of two functions. The resulting function is called the convolution product. 
This convolution product will play an important role in systems analysis. 

The convolution product of two piecewise smooth periodic functions f and g, both 
with period T, is denoted by f * g and is defined by 

1 f T l 2 

(/ * g)( 0 =~ fit- Tt)g(Tt) dr. 

1 J-T/2 

When / and g are periodic with period T, then so is the convolution product. 
Specifically, for all k e Z one has 

(f*g){t + kT) = i [ T/2 f(t+kT -T)g(T)dT 
1 J-T/2 

= tp f fit - r)g(r)dz = (f*g)(t). 

I J-T/2 
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THEOREM 4.7 

Fourier coefficients of a 
convolution product 


EXAMPLE 4.4 


If we now multiply the Fourier coefficients of two functions, then the resulting num¬ 
bers are the Fourier coefficients of the convolution product of the two functions. 

Let f{t ) and g(t ) be piecewise smooth periodic functions with Fourier coefficients 
fn and g n ■ Then If *g)lt) has a convergent Fourier series with Fourier coefficients 
if * g) n satisfying 

if * g)n — fngn- 
Proof 

Since / and g are piecewise smooth periodic functions, it follows that the convolu¬ 
tion product f * g is also a piecewise smooth function. We state this without proof. 
Hence, f * g has a convergent Fourier series. For the Fourier coefficients in this 
series one has 

1 r T / 2 ■ , 

if*g)n = = / if * g)(t)e- ln ^‘dt 
1 J-T/2 

1 f T/2 / f T/2 \ . 

= -y / / fit-r)gir)dr )e-"'^ , dt. 

T- J-T/2 \J-T/2 J 

Under the conditions of the theorem one may interchange the order of integration 
and so 

1 r T / 2 / 1 r T / 2 \ 

(/ * g)n = i=\ (r fit- z)e~ in ^it-r) dt g(T)e -i™>or dr . 

t J-T/2 \ 1 J-T/2 J 

The expression in parentheses in the right-hand side is the nth Fourier coefficient of 
/, and by applying once again the definition of the Fourier coefficients for g, the 
proof is completed: 

1 f 7 ’/ 2 

if * g)n = fn-\ g(T)e-" ,MoT dr = fngn. 

1 J-T/2 

■ 

In this example we will see how the convolution of two periodic block functions 
gives rise to a periodic triangle function, whereas the Fourier coefficients of the 
triangle functions can be obtained by multiplying the Fourier coefficients of the two 
block functions. In doing so, we verify theorem 4.7. 

Consider the periodic block function / with period 2 and a = 1 from example 
3.4. The function equals 1 for 1 1 \ < j and 0 for 2 < Ul < 1. Calculating the 
convolution of / with / according to definition 4.2 gives 

1 f 1 1 f'/2 

(/*/)0)=^/ fit - r) fir) dr = - / fit - r) dr. 

-J -1 2 J-1/2 

One has that fit — r) = 1 for —^ < t — r < that is, for t — \ < r < t + 7 . 
This means that the integral equals 

1 [V2 1 — t 

if * f)it) = g ldr — —-— for 0 < t < 1, 

2 Jt- 1/2 2 

1 [>+ l /2 1 + t 

if * f)it) = g 1 dr =—— for — 1 < f < 0. 

2 J -1/2 2 

Hence, up to a factor j, the convolution is precisely the periodic triangle function / 
with period 2 and a = 2 from section 3.4.2. Furthermore, according to example 3.4 
one has for the Fourier coefficients of the block function that c n = sininn/2)/nn 
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for n 7 ^ 0 and eg = 4- The squares of these coefficients are sirr inn/2)/n~n~ for 
n 0 and | for n = 0. Multiplied by 2 these are exactly the Fourier coefficients of 
the periodic triangle function from section 3.4.2 for a = 1, tug = 7 r and T = 2. ^ 


4 . 3.2 Parseval’s identity 


THEOREM 4.8 

Parseval’s identity 


Power of piecewise smooth 
periodic function 


In this subsection we will show that for a large class of functions, Bessel’s inequality 
from section 4.1 is in fact an equality. Somewhat more general is the following 
Parseval identity, which has important applications in the analysis of signals and 
systems. 


Let fit ) and git ) be piecewise smooth periodic functions with Fourier coefficients 
f n and g n . Then 


1 fT/2 _ 

- f{t)g(t)dt = 

L J-T/2 


oo 

T*. fngn- 
n=—o o 


(4.13) 


Proof 

According to theorem 4.6, the Fourier coefficients of the product h of two func¬ 
tions / and g are given by fngk-n ■ In particular this holds for 

the Fourier coefficient h q, for which, moreover, one has by definition that h g = 


(1/7') ,j 7 f(t)g(t)dt. Combining these facts, it follows that 

r T f 2 

T J-T/2 


oT/2 oo 

/ fit) git) dt = h Q = V fng-n- 

J-T/2 


Instead of the function g we now take the conjugate function g. According to theo¬ 
rem 3.2 the Fourier coefficients of g are g_„, proving (4.13). g 


It is now just a small step to prove that the Bessel inequality is an equality for 
piecewise smooth functions. In order to do so, we take git) in theorem 4.8 equal to 
the function fit). The Fourier coefficients of fit) will be denoted by c n again. We 
then obtain 


I [ T/2 

T J-T/2 


\fit)\ 2 dt = 


1 [ T ! 2 _ 

- fit)fit)dt = 
1 J-T/2 


oo 

^ ^ c n ( n 
n——o o 


oo 

= T. i c„ r. 

n=—o o 


(4.14) 


In section 1.2.3 the power P of a periodic time-continuous signal was defined as 
(1/7") f/j'p I fit) | 2 dt. If fit) is a piecewise smooth periodic function, then ac¬ 
cording to (4.14) the power can also be calculated using the Fourier coefficients: 


P 


I rT/2 

T J-T/2 


I fit) \ 2 dt = 


i c « i" • 


4.3.3 Integration 

Using Parseval's identity from the previous subsection, one can derive a result con¬ 
cerning the relationship between the Fourier coefficients of the integral of a periodic 
function and the Fourier coefficients of the periodic function itself. We thus want 
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THEOREM 4.9 

Integration of Fourier series 


to find an expression for the Fourier coefficients of f!_jn /( T ) dr. If this integral 

is to be a periodic function in t again, one should have f’^-fp fir) dr = 0, that is, 
c 0 = 0. 


Let f(t) be a piecewise smooth periodic function with period T and Fourier coeffi¬ 
cients c n for which eg = 0. Then the function h(t) defined by h(t) = f!_pp /( T ) dr 
is also periodic with period T and one has for all t e R: 


oo 

h(t)= J2 Ke inwot ' 

n =—oo 


with 


hn — 


h 0 = 


c n 

incoQ 

oo 

- E 

n=—o 
njt 0 


for n 0, 

(~D”c n 

into o 


(4.15) 


Proof 

Since / (t) is a piecewise smooth periodic function with cq = 0, the function h(t) = 
•f-T/2 f( r )dr is also a piecewise smooth periodic function and thus equal to its 
Fourier series. In order to determine the Fourier coefficients of hit), we introduce a 
piecewise smooth function g(r) on the interval (-T /2, T /2) satisfying 


1 for — T/2 < r < r, 
0 for t < r < T/2. 


With the function g(r) thus defined it follows that 

r> rT /2 _ 

h(t)= / f{r)dr= / f(r)g(r)dr. 

J—T /2 J-T/2 

Parseval’s identity may now be applied to the functions f{r) and g{r). If, moreover, 
we substitute for g n the definition of the nth Fourier coefficient of g(r), then we 
obtain 

oo oo rT/2 

h(t) = T V c ngn = V c„ gir)e~ in ^r dT 

n=— oo n=—oo J-T/2 

OO 

= V c n I e inmaz dr. 
n±^oo J-T/2 

Since cq = 0 it follows that 


hit) 



e in coQX dr 


E 

n=—o o 
n^0 


c n c ino)ot 
incoQ 


E 

n=—o o 
n^0 


Cni~ D" 
ina>o 


This final expression is the Fourier series of the function hit) having coefficients 
hfi — c n /incoQ for n / 0 and coefficient Iiq equal to the second series. g 


From theorem 4.9 we can conclude that if the Fourier series is known for a piece- 
wise smooth periodic function and if eg = 0, then instead of integrating the function 
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EXAMPLE 4.5 


EXAMPLE 4.6 


THEOREM 4.10 

Differentiation of Fourier 
series 


one may integrate its Fourier series term-by-term. The resulting series converges to 
the integral of the function. 

Consider the periodic function / with period 2 for which /(f) = 1 for — 1 < f < 
0 and /(f) = — 1 for 0 < f < 1. One can easily check (see exercise 3.22, if 
necessary) that the Fourier coefficients of this function are given by co = 0 and 
c n = ((—1)" — V)/imr. Furthermore, fLj/j f( T ) dr is a periodic triangle function 
with period 2 and a = 1. According to section 3.4.2 its Fourier coefficients are equal 
to (1 — (—l)")/u“7r 1 2 , which indeed equals c n /inn. The zeroth Fourier coefficient 

From (4.10) it immediately follows that 

4 y, 1 _ 1 

^ ^ ( 2 k - 1 ) 2 “ r 

◄ 


of this periodic triangle function equals 1/2. 
indeed 


y c„(— l) n y l-(-l)" 

n^oo i,17t ni^oo ^ 

n^O n^O 


4.3.4 Differentiation 

In section 4.3.3 we have seen that the Fourier coefficients of the integral of a piece- 
wise smooth periodic function with cq = 0 can be derived quite easily from the 
Fourier coefficients of the function itself. The function could in fact be integrated 
term-by-term and the resulting series converged to the integral of the function. In 
this section we investigate under which conditions the term-by-term derivative of the 
Fourier series of a function converges to the derivative of the function itself. Term- 
by-term differentiation leads less often to a convergent series. It is not hard to un¬ 
derstand the reason for this. In section 4.3.3 we have seen that integrating a Fourier 
series corresponds to a division of the nth term by a factor proportional to n, improv¬ 
ing the rate of convergence of the series. However, differentiating a Fourier series 
corresponds to a multiplication of the nth term by a factor proportional to n. and this 
will diminish the rate of convergence. 

Consider the sawtooth function /(f) = 2 t/T for —T/2 < t < T /2 from section 
3.4.3. We have seen that the Fourier coefficients are equal to i (— 1)” /nn and so the 
Fourier series is equal to Yl'nL-oo *( — i) n e lnc ° o1 /rut. The sawtooth function has 
discontinuities at t = ±T/2, ±3T/2, .... If we differentiate the Fourier series of 
the sawtooth function term-by-term, then we find 

oo oo 

J2 i(-l) n in(o 0 e inmot /nn = X (-l) n+l co 0 e in(oot /n. 

n—— oo n=—o o 

This series does not converge, since the terms in the series do not tend to 0 for 
n —> oo. ^ 

It turns out that continuity of the periodic function is an important condition for 
the term-by-term differentiability. We formulate this in the following theorem. 

Let f(t) be a piecewise smooth periodic continuous function with Fourier coeffi¬ 
cients c n and for which f'{t) is piecewise smooth as well. Then 

1 oo 

2 (/ , ( r +'> + /'(/-)) = XI ina>0 c n e ln(aot . 

n =—oo 


(4.16) 
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4.10 

4.11 

4.12 


Proof 

Since f'(t) is piecewise smooth, f'(t) has a convergent Fourier series. Let c' n be 
the Fourier coefficients of fit), then 

1 f 7 '/ 2 

c' n = - f\t)e~ lnwot dt. 

1 J-T/2 

Since / is continuous, one can apply integration by parts. We then find: 
c'n = Y [/( t)e - in(O0t ] T ^, 2 + /j; me- ino *‘ dt. 

The first term in the right-hand side is 0 for all n, since /(f) is periodic, so 
/(—T/2) = f(T/ 2), and e ~' na>oT / 2 = e lna> ° T / 2 . The second term is, by defini¬ 
tion, up to a factor incog, equal to c n and hence 

c'n = incogCn. 

If we now apply the fundamental theorem to the function f' it follows that 

1 oo oo 

+ /'(*-)) = E &*“* = E incogcne^' . 

n =—oo n=—o o 


In order to derive the equality c' n = incogc,, in the proof of theorem 4.10, we did 
not use the assumption that fit) was piecewise smooth. Hence, this equality also 
holds when f' it) is piecewise continuous. If we now apply the Riemann-Lebesgue 
lemma to the function it follows that lim^^-too c’ n = lim„_ s . = i =00 incogc n = 0. 
This proves statement b about the rate of convergence from section 4.2. By applying 
this repeatedly, statement c follows (see also exercise 4.20). 

EXERCISES 

Equation (4.14) has been stated for complex Fourier coefficients. Give the equation 
if one uses the ordinary Fourier coefficients. 

An application of ParsevaTs identity can be found in electronics. Suppose that in 
an electric circuit the periodic voltage v(f) gives rise to aperiodic current /(f), both 
with period T and both piecewise smooth. Let v„ and i n be the Fourier coefficients 
of v(f) and /(f) respectively. Show that for the average power P over one period 
(see section 1.2.3) one has 

oo oo 

P = ^ ' Vnin = ^ , Vtii-n- 

n ——oo n=—o o 

Consider the periodic block function /(f) with period n and for some ael with 
0 < a < Tt, and the periodic block function g(t) with period n and some be R 
with 0 < b < jt (see section 3.4.1). Assume that a < b. 
a Use ParsevaTs identity to show that 

sin na sin nb a(n — b) 

2 -^ ^2 = o ' 


b Choose a = b — Tt /2 and derive (4.10) again. 
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4.13 


4.14 


4.15 


4.16 


4.17 


Consider the periodic triangle function from section 3.4.2 for a = T /2. 
a Use (4.14) to obtain that 

y-. I 111 _ n 4 

tho (2« + l) 4 ~ 1 + 3 4 + 5 4 + 7 4 + " ' “ 96 ' 

b Let S = 1 Split this into a sum over the even and a sum over the odd 

positive integers and then show that 5 = 7r 4 /96 + 5/16. Conclude that 


\ 1 71 

~ on' 


Let f(t) be the periodic function with period 2 defined for — 1 < t < 1 by 

| t 2 + t for— 1 < f < 0, 

' r ^ I — t 2 + t for0<f<l. 


a Use the results from exercise 4.9 to show that 


oo , 

E — 1 

nb _l 


^(Ik + 1) 6 960' 

b Use part a and the method of exercise 4.13b to show that 

L k 6 “ 945 ' 
k= 1 

Let fit) be a piecewise smooth periodic function with period T and Fourier series 
J2nL-oo Cne inc ° ot , where cq = 0. Show that for — T/2 < a < b one has 


oo 

/ f(t)dt= Y JiH-( e ‘na>ob _ e inco 0 ay 

J a 


‘—' mcor\ 
n =—oo u 
njtO 


Let f(t) be a piecewise smooth periodic function with period T and with Fourier 
coefficients a„ and h„, where ciq = 0. Show that for —T/2<a<b one has 

rb i 

I f(t)dt — f - (a n (s'mna>ob — sin nw^a) — b„(cosna>Qb — cosrccuofl)). 

Ja n<v 0 

Consider the periodic function f(t) with period 2n defined for — n < t < Tt by 


fit) = 


— 1 for — n < t < 0, 

1 for 0 < t < it. 


a Determine the ordinary Fourier coefficients of / and give the Fourier series of 
/■ 

b Integrate the series from part a over [—7r, t ] and determine the resulting constant 
using (4.10). 

c Show that the function represented by the series from part b is the periodic 
function with period 2n given by g(t) = \ t\ — n for — n < t < n. 
d Use exercise 3.6 to determine in a direct way the ordinary Fourier series of the 
function g from part c and use this to verify the result from part b. 
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4.18 


4.19 

4.20 

4.21 

4.22 


4.23 

4.24 


Consider the periodic function fit) with period 2 from exercise 4.14. Use the inte¬ 
gration theorem to show that 

4 1 4 -22, 1 

gm = — Y _-_+ — V _'_ e mnt 

n£^oo (2« + l) 4 ^ 2 „ir' 00 (2n+l)4 


where g(t) is the periodic function with period 2 given for — 1 < t < 1 by 


git) = j \ t | 3 - \t 2 + i. 


Finally calculate the Fourier coefficient cq of g(t) and check your answer using 
exercise 4.13a. 

Show that theorem 4.10 reads as follows, when formulated in terms of the ordi¬ 
nary Fourier coefficients. Let f(t) be a piecewise smooth periodic continuous func¬ 
tion with ordinary Fourier coefficients a n and b n and for which f it) is piecewise 
smooth. Then 


\if\t- F) + f'it—)) = T.{n<*>ob n cos na) 0 t — nct)oa n sinn&>oO- 


Let f(t) be a periodic continuous function with piecewise smooth continuous deriva¬ 
tive f'it). Show that liniH-^-too n~c n — 0. 

In the example prior to theorem 4.10 we saw that the Fourier series of the periodic 
sawtooth function fit) with period T, given by fit ) = 2f/ T for — T/2 < t < T/2, 
could not be differentiated term-by-term. However, now consider the even function 
git) with period T given by /(f) = 2t/T for 0 < t < T/ 2. 
a Determine the Fourier cosine series of the function git). 

b Differentiate the series from part a term-by-term. Verify that the result is the 
Fourier sine series of the function g'it) and that this series converges to g'it) for all 
t / nT /2 in e Z). How can this result be reconciled with theorem 4.10? 

a Determine the Fourier series of the periodic function with period 2 n defined for 
—tc < t < n by 


m = 


0 for —tc < t < 0, 
sin t for 0 < t < tc . 


b Verify that we can differentiate / from part a by differentiating its Fourier se¬ 
ries, except at t = me in e Z). Describe the function that is represented by the 
differentiated series. 

Formulate the convolution theorem (theorem 4.7) for the ordinary Fourier coeffi¬ 
cients. 

Let / be the periodic block function with period 2 and a = 1, so fit) = 1 for 
1 1 1 < ^ and fit) = 0 for ^ < 1 1 \ < 1. Let g be the periodic triangle function with 
period 2 and a = j, so git) = 1 — 2 1 1 \ for 1 1 \ < ^ and git) — 0 for ^ < 1 1 \ < 1. 
a Show that f\ * f-± is even when both f\ and /2 are even periodic functions with 
period T. 
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b Show that f * g is the even periodic function with period 2 which for 0 < t < 1 
is given by 


forO < t < 
for j < t < 1. 

c Determine the Fourier series of (f*g){t) and verify that it converges to ( f*g)(t ) 
for all (el. 

d Verify the constant in the Fourier series of (/ * g)(f) by calculating the zeroth 
Fourier coefficient in a direct way. 


(/*£)« = 


_I f 2 +L 
2 1 '4 

kt- D 2 


Overshoot 


4.4 The sine integral and Gibbs’ phenomenon 

The fundamental theorem of Fourier series was formulated for piecewise smooth 
functions. According to this theorem, the series converges pointwise to the function. 
Possible points of discontinuity were excluded here. At these points, the series con¬ 
verges to the average value of the left- and right-hand limits of the function. Towards 
the end of section 4.2 we already noted that in a small neighbourhood of a disconti¬ 
nuity, the series will approximate the function much slower. This had already been 
observed by Wilbraham in 1848, but his results fell into oblivion. In 1898 the physi¬ 
cist Michaelson published an article in the magazine Nature, in which he doubted 
the fact that ‘a real discontinuity (of a function /) can replace a sum of continuous 
curves’ (i.e., the terms in the partial sums $„(()). This is because Michaelson had 
constructed a machine which calculated the nth partial sum of the Fourier series of 
a function up to n = 80. In a small neighbourhood of a discontinuity, the partial 
sums s n (t) did not behave as he had expected: the sums continued to deviate and the 
largest deviation, the so-called overshoot of s n (t) relative to /(?), did not decrease 
with increasing n. In figure 4.3 this is illustrated by the graphs of the partial sums 
approximating the periodic block function for different values of n. We see that the 
overshoots get narrower with increasing n, but the magnitude remains the same. In 



FIGURE 4.3 

Partial sums of the periodic block function. 

a letter to Nature from 1899, Gibbs explained this phenomenon and showed that 
s n (t) will always have an overshoot of about 9% of the magnitude of the jump at the 
discontinuity. We will investigate this so-called Gibbs’ phenomenon more closely 
for the periodic block function. Before we do so, we first introduce the sine integral, 
a function that will be needed to determine Gibbs’ phenomenon quantitatively. The 
sine integral will be encountered in later chapters as well. 
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DEFINITION 4.3 

Sine integral 


4.4.1 The sine integral 


The sine integral is a function which is used in several places. It is defined as follows. 


The sine integral is the function Si(x) defined by 


f x sint 

Si(jc) = / - dt. (4.17) 

Jo t 

Since | sin t/1 \ < 1 for all t 0, the integrand is bounded and the integral well- 
defined. Furthermore, we have Si(0) = 0. The sine integral cannot be determined 
analytically, but there are tables containing function values. In particular one has 


C n sinr 

Jo ~ 


Si(jr) = / -r/f= 1.852.... 


The definition of Si(jc) can also be used for negative values of x, from which it 
follows that Si(v) is an odd function. Starting from the graph of sinf/r, the graph 
of Si(x) can be sketched; see figure 4.4. Figure 4.4 seems to suggest that Si(^r) 
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FIGURE 4.4 

Graphs of the functions sin t/t (a) and Si(.r) (b). 


converges to jr/2 for x —> oo. Although Si(.r) cannot be calculated analytically, 
one is able to determine its limit. 

For the sine integral one has 


-L 


.sin t n 

lim Si(x) = / - dt = —. 

' 0 r 2 

Proof 

In order to prove this, we introduce for p > 0 the function I(p) defined by 


/■OO 

I Ip) = / e~ p, sintdt. 

Jo 


Using integration by parts twice we can derive that for p > 0 one has 


,,p) - L 

-[ 


e pt sin t dt = 


-e.-Pt 


cos t 


-[■ 

L 


-e~P< . ' 

-sin t 

P JO 

oo e -pt 


+ 


L 


oo -pt 


■ cos t dt 


0 P 


1 1 

sin t dt = — - ~I(p). 

pA pA pA 
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The first and last term are equal. If we solve for lip), we obtain 
/( P) = 7~ — 7- 

1 + p~ 

Next we integrate I ip) over the interval (0, oo) to obtain 


r oo r oo | 

/ i( P )dp= — 
Jo Jo 1 + 


“2 dp = [arctanp]g =-. 
P 


(4.18) 


On the other hand we find by interchanging the order of integration that 


/•OO /-OO / /-OO \ /• 

I I ip) dp = / (/ e~ p, smtdp)dt = 

Jo Jo VO / Jo 




-t 


p=oo 


sin t dt 


Jp=0 


r 

Jo 


sint 


- dt. 


(4.19) 


We state without proof that interchanging the order of integration is allowed. With 
the equality of the right-hand sides of (4.18) and (4.19) the theorem is proved. g 


4.4.2 Gibbs’ phenomenon* 


In this section we treat Gibbs’ phenomenon. It is a rather technical treatment, which 
does not result in any specific new insight into Fourier series. This section may 
therefore be omitted without any consequences for the study of the remainder of the 
book. 

We treat Gibbs’ phenomenon using the periodic block function. Since it will 
result in much simpler formulas, we will not start from the periodic block function 
as defined in section 3.4.1, but instead from the periodic function /(f) defined on 
the interval (-T /2, T /2) by 

I A for 0 < t < A T, 

\ , 

— j for — A T < t < 0. 

This odd function has a Fourier sine series whose coefficients have been calculated 
in exercise 3.22. The partial sums s„(t) of the Fourier series are 


n 2 

Sn(t) = — sin((2fc - 1 )co 0 t). (4.20) 

k=\ ^ 77 

The graph of the partial sum for n — 12 is drawn in figure 4.5. In it, Gibbs’ phe¬ 
nomenon is clearly visible again: immediately next to a discontinuity of the function 
fit), the partial sum overshoots the values of /(f). We will now calculate the over¬ 
shoot, that is, the magnitude of the maximum difference between the function and 
the partial sums immediately next to the discontinuity. By determining the deriva¬ 
tive of the partial sum, we can find out where the maximum difference occurs, and 
subsequently calculate its value. Differentiating s n it) gives 


n 2 ”4 

s' n it) = Y2 -£O 0 cos((2fc - l)o> 0 f) = ^2 — cosi(2k - l)w 0 f). (4.21) 

k= 1 n k= 1 1 

In order to determine the zeros of the derivative, we rewrite the last sum. For this 
we use the trigonometric identity sin a — sin fi = 2 sin((a — fi) /2) cos((a + fi) /2). 
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FIGURE 4.5 

Overshoot of the partial sums approximating the block function. 


With a — 2kaiQt and j3 = (2k — 2)a>Qt it follows that 

sin2£<wof — sin((2fc — 2)<w 0 f) 

cos((2 a: - l)to 0 f) = - — -. 

2 sinwo? 

By substituting this into expression (4.21) for the derivative s' n (t) it follows that 


, 2 sin 2 ncont 

s' n (t) = -— -5_, 

T sin toyt 

since consecutive terms cancel each other. The derivative is 0 if 2na>Qt = kn for 
k e Z and k 0. We thus have extrema for s n (f) at t = kn/2na>Q. For k = 1 we 
find the first extremum immediately to the right of t = 0, that is, for t = n/2na>Q. 
The value at the extremum can be found by substituting t = n/2na>Q in s n (t). This 
gives 


S n ( 


n \ 


V 2n "oJ ^ 

n 

= E 


k =1 


(2k - 1)jt 
2 

(2k - 1)tt 


sin ( (2k — 1 )o>q- 


2 ri( 0 ()) 
sin((2A: — l)^/2n)- 


The last sum can be rewritten as an expression which is a Riemann sum with stepsize 
n/n for the function sinjc/x: 


/ tv \ 1 n sin((2 k — l)n/2n) 

\2na>o) rt n (2k — l)n/2n 


Taking the limit n —> oo, the sums in the right-hand side converge to the integral 
Jq (sin x/x)dx. Note that for large values of n the contribution of the nth term gets 
smaller and smaller and will even tend to zero (since the series converges to the 
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4.25 

4.26 


4.27* 


integral). The value of this integral was given in section 4.4.1 and hence 

( Jt \ 1 7r sin((2fc — l)n/2n ) 

lim s n - = lim — >- 

n—>oo \2ncoQ J n->oo n ^' n (2k — l)n/2n 

1 I" 71 sin* 1 

= -/ - dx = - 1.852... =0.589.... 

n Jo x tv 

This establishes the value at the first maximum next to the jump. Since the jump 
has magnitude 1, the overshoot of the function value 0.5 is approximately 9% of 
the jump. Since the additional contribution for large values of n gets increasingly 
smaller, this overshoot will remain almost constant with increasing n . Furthermore 
we see that the value of t where the extremum is attained is getting closer and closer 
to the point of discontinuity. 

In this section we studied Gibbs’ phenomenon using the periodic block function. 
However, the phenomenon occurs in a similar way for other piecewise smooth func¬ 
tions having points of discontinuity. There is always an overshoot of the partial sums 
immediately to the left and to the right of the points of discontinuity, with a value 
approximately equal to 9 % of the magnitude of the jump. As more terms are being 
included in the partial sums, the extrema are getting closer and closer to the point of 
discontinuity. 

EXERCISES 

Use the definition to verify that the sine integral Si(.r) is an odd function. 

The sine integral can be considered as an approximation of the function /(*) given 
by fix) = jt/ 2 for* > 0 and /(*) = — 7 t/ 2 for* < 0. 
a What is the smallest value of x > 0 for which Si(v) has a maximum? 
b What is the value of Si(x) at the first maximum and what percentage of the jump 
at * = 0 of the function /(*) does the overshoot amount to? 

Consider the periodic function with period T given by f(t) — 2t/T — 1 for 0 < 
t < T. Let s n (t) be the nth partial sum of the Fourier series of /. 
a Show that / arises from the sawtooth function from section 3.4.3 by a shift over 
T /2. Next determine s n ( t ). 
b Show that 

s' n (t) = -j(D n (t) - 

where D n is the Dirichlet kernel from definition 4.1. Subsequently determine the 
value of t for which s„ (t) has its first extreme value immediately to the left of the 
discontinuity at t = 0. 

c Calculate the magnitude of the extremum from part b and show that the over¬ 
shoot is again approximately equal to 9 % of the magnitude of the jump at t = 0. 


SUMMARY 

When a periodic function is piecewise continuous, its Fourier coefficients, as de¬ 
fined in chapter 3, exist. According to Bessel’s inequality, the sum of the squares of 
the moduli of the Fourier coefficients of a periodic piecewise continuous function 
is finite. From this, the lemma of Riemann-Lebesgue follows, which states that the 
Fourier coefficients tend to 0 for n —> ±oo. The fundamental theorem of Fourier 
series has been formulated for piecewise smooth periodic functions. For such func¬ 
tions the Fourier series converges to the function at the points of continuity, and to 
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the average of the left- and right-hand limit at the points of discontinuity. If / is a 
piecewise smooth periodic function with period T, then one has, according to the 
fundamental theorem, 

oo 

= 2 (/('+) + fit-)) , 

Tl — — OO 


where 

1 r T ! 2 ■ . 2 :r 

c n = ~ f (t)e mw °'dt and to 0 = —. 

' J-T/2 i 

As functions are smoother, meaning that higher derivatives do not contain discon¬ 
tinuities, the convergence of the Fourier series to the function is faster. Using the 
fundamental theorem, further properties of Fourier series were derived, such as se¬ 
ries for products and convolutions, term-by-term differentiation and integration of 
Fourier series, and Parseval’s identity 


1 [ T / 2 _ 

- f(t)g(t)dt = 

1 J-T/2 


OO 

fngn, 

n=—oo 


where f n and g„ are the Fourier coefficients of / and g. 

While the Fourier series of a piecewise smooth function with discontinuities does 
converge at each point of continuity to the function value, the series always has an 
overshoot of about 9 % of the magnitude of the jump immediately next to a point 
of discontinuity. This phenomenon is called Gibbs’ phenomenon. As more terms 
are included in the partial sums, the overshoot shifts closer and closer to the point 
of discontinuity. For the analysis of this phenomenon we defined the sine integral 
Si(.v), having as properties Si(7r ) = 1.852... and lime-s-oo Si(.v) = n/2. 


4.28 


4.29 


SELFTEST 


Let /(f) be the odd periodic function with period 2n defined for 0 < t < Jt by 

[ —t for 0 < t < —, 

fit) = | n 7T 2 

1 for — < t < n. 

I 2 

a For which values of t e R does the Fourier series of /(f) converge? What is the 
sum for those values of f for which there is convergence? 

b Determine the Fourier series of / and verify the fundamental theorem of Fourier 
series for f = 0 and f = n. 

c Can one differentiate the function / by differentiating the Fourier series term- 
by-term? If not, explain. If so, give the function that is represented by the differen¬ 
tiated series. 

d Can one integrate the function / over [— tc, f] by integrating the Fourier series 
term-by-term? If not, explain. If so, give the function that is represented by the 
integrated series. 


Let ael with 0 < a < n/2. Use the periodic block function p a ,n and the periodic 
triangle function q a<71 to show that 


■£5, sin 3 na a 2 
n =1 
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4.30 


4.31 


Finally evaluate 


E 


n =0 


(- 1 )" 

(2 n + l) 3 ' 


Let f(t) be the periodic function fit) = | sinf | with period 2n. 
a Find the Fourier series of / and verify that it converges to f(t) for all (el. 
b Show that 

^ 1 _ 1 “ (_i)» _ 1 n 

^4n2TT“2 “ 2“ 4‘ 

n= 1 n =1 

c Show that 


\ 1 TV 

(4 n 2 - l) 2 16 


1 

2 ' 


Let / be the periodic sawtooth function with period 2 given by f(t) = t for — 1 < 
t < 1 . 

a Show that f\*fi is an even function if both /j and are odd periodic functions 
with period T. 

b Show that / * / is the even periodic function with period 2 which for 0 < t < 1 
is given by (f*f)(t) = — \t 2 + t— (Flint: how can one express / for 1 < t < 2? 
Now split the integral in two parts.) 
c Prove that for all t e R we have 

2 ^ 1 

(/ * /HO =-y > — cos njrt. 

n- —! n- 
n= 1 

d Show that for t — 0, the result from part c is equivalent to Parseval’s identity 
(4.14) for the function /. 

e Verify that term-by-term differentiation of (/ * f){t) is allowed for 0 < 1 1 \ < 1 
and describe for all t e R the function that is represented by the differentiated series, 
f Determine in a direct way the zeroth Fourier coefficient of (/ * /)(D and verify 
the answer using the result from part c. Next, verify that term-by-term integration 
over [—1,0 is allowed and describe for all t e R the function that is represented by 
the integrated series. 
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CHAPTER 5 


Applications of Fourier series 


INTRODUCTION 


Applications of Fourier series can be found in numerous places in the natural sci¬ 
ences as well as in mathematics itself. In this chapter we confine ourselves to two 
kinds of applications, to be treated in sections 5.1 and 5.2. Section 5.1 explains how 
Fourier series can be used to determine the response of a linear time-invariant sys¬ 
tem to a periodic input. In section 5.2 we discuss the applications of Fourier series 
in solving partial differential equations, which often occur when physical processes, 
such as heat conduction or a vibrating string, are described mathematically. 

The frequency response, introduced in chapter 1 using the response to the peri¬ 
odic time-harmonic signal e ,u>t with frequency a>, plays a central role in the cal¬ 
culation of the response of a linear time-invariant system to an arbitrary periodic 
signal. Specifically, a Fourier series shows how a periodic signal can be written as 
a superposition of time-harmonic signals with frequencies being an integer multiple 
of the fundamental frequency. By applying the so-called superposition rule for lin¬ 
ear time-invariant systems, one can then easily find the Fourier series of the output. 
This is because the sequence of Fourier coefficients, or the line spectrum, of the out¬ 
put arises from the line spectrum of the input by a multiplication by the frequency 
response at the integer multiples of the fundamental frequency. 

For stable systems which can be described by ordinary differential equations, 
which is almost any linear time-invariant system occurring in practice, we will see 
that the frequency response can easily be derived from the differential equation. 
The characteristic polynomial of the differential equation of a stable system has 
no zeros on the imaginary axis, and hence there are no periodic eigenfunctions. 
As a consequence, the response to a periodic signal is uniquely determined by the 
differential equation. If there are zeros ia> of the characteristic polynomial on the 
imaginary axis, then a periodic input may lead to resonance. For the corresponding 
frequencies a>, the frequency response is meaningless. 

In the second and final section we treat applications of Fourier series in solv¬ 
ing partial differential equations by separation of variables. This method is ex¬ 
plained systematically in the case when the functions have one time-variable and 
one position-variable. We limit ourselves to simple examples of initial and boundary 
value problems, with the partial differential equation being either the one¬ 
dimensional diffusion or heat equation, or the one-dimensional wave equation. 
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LTC-system 


THEOREM 5.1 


LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- can express the line spectrum of the response of an LTC-system to a periodic input 
in terms of the frequency response and the line spectrum of the input 

- know what eigenfunctions and eigenfrequencies are for a system described by a 
differential equation, and know the relevance of the zeros of the corresponding 
characteristic polynomial 

- know when the periodic response of an LTC-system to a periodic input is uniquely 
determined by the differential equation, and know what causes resonance 

- can determine the frequency response for stable LTC-systems described by a dif¬ 
ferential equation 

- can use separation of variables and Fourier series to determine in a systematic way 
a formal solution of the one-dimensional heat equation and the one-dimensional 
wave equation, under certain conditions. 


5.1 Linear time-invariant systems with periodic input 

In this section we will occupy ourselves with the determination of the response of 
a linear time-invariant continuous-time system (LTC-system for short) to a periodic 
input. Calculating the response as a function of time or, put differently, determining 
the response in the time domain, is often quite difficult. If, however, we have the 
line spectrum of the input at our disposal, so if we know the sequence of Fourier 
coefficients, then it will turn out that by using the frequency response of the LTC- 
system it is easy to determine the line spectrum of the output. Apparently it is easy 
to calculate the response in the frequency domain. 

The frequency response of an LTC-system was introduced in chapter 1 by the 
property 

e imt H((d)e ia>t . 

That is to say, the response to the time-harmonic signal e uot of frequency a> is equal 
to H(co)e ,mt . We assume that for periodic inputs u(t) one has that 

oo 

«(0= J2 u ne inwot , (5.1) 

n=—o o 

where cog — 2 tt/T and u n is the sequence of Fourier coefficients, or line spectrum, 
of u(t). When u(t) is a piecewise smooth function, then we know from the fun¬ 
damental theorem of Fourier series that (5.1) holds everywhere if we assume that 
u(t) = (u(t+) + u(t—))/2 at the points of discontinuity of u(t). In the present 
chapter this will always be tacitly assumed. One now has the following theorem. 

Let y(t) be the response of a stable LTC-system to a piecewise smooth and periodic 
input u(t) with period T, fundamental frequency cog and line spectrum u n . Let H(a>) 
be the frequency response of the system. Then y(t) is again periodic with period T 
and the tine spectrum y n ofy(t) is given by 

y n = H(na>g)u n forn — 0, ±1, ±2, .... (5.2) 

Proof 

Let the line spectrum u n of the input u(t) be given. Then (5.1) holds, which repre¬ 
sents u(t ) as a superposition of the time-harmonic signals e' na,ot with frequencies 
ncog. If only a finite number of Fourier coefficients u n are unequal to zero, then 
u(t) is a finite linear combination of time-harmonic signals. Because of the linearity 
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Superposition rule 


EXAMPLE 5.1 


of the system, in calculating the response it is sufficient first to determine the re¬ 
sponses to the time-harmonic signals and then to take the same linear combination 
of the responses. 

We now assume that for LTC-systems this property may be extended to infinite 
linear combinations of time-harmonic signals, so to series such as Fourier series 
from (5.1). We then say that for LTC-systems the superposition rule holds (also see 
chapter 10). This means that first one can determine the response to a time-harmonic 
signal with frequency na>Q using the frequency response. Because of the stability of 
the LTC-system we know that H (o>) is defined for all values of a> (see section 1.3.3). 
On the basis of the superposition rule one thus has that 

oo 

y(t)= ^2 u„H(na) 0 )e ,n(oot . 

n=—o o 

We see that y{t) is periodic with period T and, moreover, that the line spectrum y n 
of the response satisfies (5.2). g 


For a stable LTC-system the frequency response is given by 


H(w) = - 7 —\ -. 

—or + 3 ia> + 2 

Consider the periodic input u(t) with period 2 n given on the interval (— n, n) by 
u(t) = t. The line spectrum y n of the response y{t) satisfies (5.2). One has 
H{ncof) = 1/(2 + 3nia>o — ft 2 a>g). The line spectrum u n of u(t) can be obtained 
by a direct calculation of the Fourier coefficients. The result is: u n = (—1 )"//n for 
n 0 , «o = 0 . Flence, 


yn = 


ft (2 + 3ina>Q — notify 

0 


for ft 7 ^ 0 , 
for ft = 0 . 


◄ 


Systems that can be realized in practice are often described by differential equa¬ 
tions. Well-known examples are electrical networks and mechanical systems. We 
will now examine how for such systems one can determine the frequency response. 


5.1.1 Systems described by differential equations 

In chapter 1 systems described by differential equations were briefly introduced. For 
such systems the relation between an input u(t ) and the corresponding output y(t) is 
described by an ordinary differential equation with constant coefficients of the form 

d m y d m ~ l y dy 

Clry] - -|- d m _1 -7- -|- • • • “h d] - -|- dfl~y 

dt m m 1 dt m ~ 1 1 dt 

d n u d n ~^u du 

= bn d^ +bn ~ l d?^ T + "' +bl ^ +bQU (53) 

Order of a differential 
equation 


with ft < m. Here oq, a 1 . a m and bQ.b\, ... ,b n are constants with a m 7 ^ 0 and 

b„ 7 ^ 0. The number m is called the order of the differential equation. An electric 
network with one source, a voltage generator or a current generator, and furthermore 
consisting of resistors, capacitors and inductors, can be considered as a system. The 
voltage of the voltage generator or the current from the current generator is then an 
input, with the output being, for example, the voltage across a certain element in the 
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network or the current through a specific branch. One can derive the corresponding 
differential equation from Kirchhoff's laws and the voltage-current relations for the 
separate elements in the network. For a resistor of resistance R this is Ohm’s law: 
v(t) — Rift), where i(t) is the current through the resistor and v(t) the voltage 
across the resistor. For a capacitor with capacitance C and an inductor with self¬ 
inductance L these relations are, respectively, 


i r’ 

v(t) = — l{T)dr 
6 J—oo 


and v(f) = L — t(f). 

dt 


The theory of networks is not a subject of this book and thus we shall not occupy 
ourselves with the derivation of the differential equations. Flence, for the networks 
in the examples we will always state the differential equation explicitly. Readers 
with knowledge of network theory can derive these for themselves; others should 
consider the differential equation as being given and describing an LTC-system. 

The same assumptions will be made with respect to mechanical systems. Here 
the differential equations follow from Newton’s laws and the force-displacement 
relations for the mechanical components such as masses, springs and dampers. If 
we denote the force by F and the displacement by x, then one has for a spring with 
spring constant k that F(t) = kx(t ), for a damper with damping constant c that 
F(t) = cdx/dt, and for a mass m that F(t) = mdrx/dt ~. In these formulas the 
direction of the force and the displacement have not been taken into account. 

The formulas for the mechanical systems are very similar to the formulas for the 
electrical networks when we replace a voltage v(t) by a force F(t) and a charge 
<2(0 = f!_ i(z)dr by a displacement. The latter means that a current i(t) is 
replaced by a velocity dx/dt. The formula for the spring is then comparable to the 
formula for the capacitor, the formula for the damper with the one for the resistor 
and the formula for the mass with the inductor. This is listed in the following table. 


electric network 
v(0 = Q(t)/C (capacitor) 
v(0 = RdQ/dt (resistor) 
v(0 = Ld-Q/dt~ (inductor) 


mechanical system 
F(t ) = kx(t ) (spring) 
F(t) = cdx/dt (damper) 
F(t) = md 2 x/dt~ (mass) 


Characteristic polynomial 


THEOREM 5.2 


In chapter 1 we already noted that LTC-systems which are equal in a mathemat¬ 
ical sense can physically be realized in different ways. Hence, mathematically a 
mechanical network can be the same as an electric network. 

For an LTC-system described by a differential equation, the frequency response 
H(a> ) can easily be obtained. To this end we introduce the polynomials 

A(s) = ajfiS -f- a m — {S 4- ■ ■ ■ -b ttis + ^0' 

B(s ) = b n s n + b n _\s n ~ l -\ -1- b\s + £>o- 


The polynomial A(s) is called the characteristic polynomial of differential equation 
(5.3). The following theorem shows how one can obtain H(a>) for those values of to 
for which A(ia >) 0. 


Let an LTC-system be described by differential equation (5.3) and have characteris¬ 
tic polynomial A(s). Then one has for all co with A(iu>) 0: 


H(w) = 


B(ia >) 
A(ia>) 


(5.4) 
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Homogeneous solution 
Eigenfunction 


Particular solution 


Characteristic equation 


Fundamental homogeneous 
solution 


Eigenfrequency 


Proof 

In order to find the frequency response, we substitute the input u(t) = e ,0>t into 
(5.3). The response y(t) is then of the form H(a,>)e lmt . Since the derivative of e lmt 
is icoe la>t , substitution into (5.3) leads to A(ia>)H(a>)e la>t — B(ia))e la>t . From this 
it follows that H(a>) = B(ico)/A(ico), which proves the theorem. g 


It is natural to examine the problems that may arise if A(ia>) = 0 for a certain 
value of ct>, in other words, if the characteristic polynomial has zeros on the imag¬ 
inary axis. In order to do so, we will study in some more detail the solutions of 
differential equations with constant coefficients. 

When the input u(t) is known, the right-hand side of (5.3) is known and from the 
theory of ordinary differential equations we then know that several other solutions 
y(t) exist. In fact, when one solution y(t ) of (5.3) is found, then all solutions can 
be obtained by adding to y (t) an arbitrary solution x(t) of the differential equation 


d m x d m ~ l x 

am d^ +am ~'J^T 


+ ■ ■ 


dx 

+ a i — + oo : 
at 


: 0 . 


(5.5) 


This differential equation is called the homogeneous differential equation corre¬ 
sponding to equation (5.3) and a solution of equation (5.5) is called a homogeneous 
solution or eigenfunction. These are thus the solutions with u(t) being the null- 
signal. Of course, the null-function x(t) = 0 for all t satisfies the homogeneous 
differential equation. This homogeneous solution will be called the trivial homoge¬ 
neous solution or trivial eigenfunction. 

We will say that the general solution y(t) of (5.3) can be written as a particular- 
solution added to the general homogeneous solution: 

general solution = particular solution + general homogeneous solution. 

The general homogeneous solution can easily be determined using the characteristic 
equation. This equation arises by substituting x(t) = e st into (5.5), where s is a 
complex constant. From example 2.11 it follows that this is the result: ( a m s m + 

■ + ai s + ao)e sr — 0. Since e st 0 one has 


„-l* n, - 1 + - 


A{s) = a m s 


, „ ra — 1 , 

+ a m —\s + • 


■ -|- Cl\S -|- City — 0. 


(5.6) 


To each zero s of the characteristic polynomial corresponds the homogeneous solu¬ 
tion e st . More generally, one can show that to a zero s with multiplicity k there also 
correspond k distinct homogeneous solutions, namely 


te‘ 


t k ~ l e st . 


Now the sum of the multiplicities of the distinct zeros of the characteristic polyno¬ 
mial is equal to the degree m of the polynomial, which is the order of the differential 
equation. So in this way there is a total of m distinct homogeneous solutions that 
correspond to the zeros of the characteristic polynomial. We call these solutions 
the fundamental homogeneous solutions, since it follows from the theory of ordi¬ 
nary differential equations with constant coefficients that the general homogeneous 
solution can be written as a linear combination of the homogeneous solutions corre¬ 
sponding to the zeros of the characteristic polynomial. 

To a zero ico on the imaginary axis corresponds the time-harmonic fundamental 
solution e ,a>t of (5.5) with period T = 2 n/ \ co | if co 0 and an arbitrary period 
if co = 0. In this case the value a> is called an eigenfrequency. Note that a time- 
harmonic fundamental solution with period T also has period 2 T, 3 T, etc. So when 
there are zeros of the characteristic polynomial on the imaginary axis, then there 
exist non-trivial periodic eigenfunctions. One can show that the converse is also 
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EXAMPLE 5.2 


Resonance 


EXAMPLE 5.3 


true, that is: if a non-trivial periodic eigenfunction with period T exists, then the 
characteristic polynomial has a zero lying on the imaginary axis and corresponding 
to this a time-harmonic fundamental solution having period T as well. 

Hence, when u(t) is a periodic input with period T and when, moreover, there 
exist non-trivial eigenfunctions having this same period, then a periodic solution 
of equation (5.3) with period T will certainly not be unique. Possibly, periodic 
solutions of (5.3) will not even exist. We will illustrate this in the next example. 

Given is the differential equation 

y" + 4y = u. 

The characteristic equation is s 2 + 4 = 0 and it has zeros 2i and —2 i on the imagi¬ 
nary axis. To these correspond the fundamental solutions e 2it and e~ 2> ’. Hence, the 
general homogeneous solution is x(t) — ae 2 ' 1 + fe~ 2it for arbitrary complex a and 
f. So all eigenfunctions are periodic with period n. Now when u(t) = 4 cos 2/ is a 
periodic input with period n, then there is no periodic solution with period n. This 
is because one can show by substitution that y(t) = t sin 2 t is a particular solution 
of the given differential equation for this u. Note that this solution is not bounded. 
The general solution is thus 

y(t) = t sin 2 1 + ae 2 " + fe~ 2lt . 

Since all homogeneous solutions are bounded, while the particular solution is not, 
none of the solutions of the differential equation will be bounded, let alone periodic. 
The periodic input u(t) gives rise to unbounded solutions here. This phenomenon is 
called resonance. ^ 

The preceding discussion has given us some insight into the problems that may 
arise when the characteristic polynomial has zeros on the imaginary axis. When 
eigenfunctions with period T occur, periodic inputs with period T can cause reso¬ 
nance. In the case when there are no eigenfunctions with period T, the theory of 
ordinary differential equations with constant coefficients states that for each periodic 
u{t) in (5.3), having period T and an nth derivative which is piecewise continuous, 
there exists a periodic solution y(t) with period T as well. This solution is then 
uniquely determined, since there are no periodic homogeneous solutions with pe¬ 
riod T. The solution y(t) can then be determined using the frequency response. We 
will illustrate this in our next example. 

Consider the differential equation 

y" + 3 y' + 2 y = cos t. 

Note that the right-hand side is periodic with period 2n. The corresponding homo¬ 
geneous differential equation is 

x" + 2>x' + 2x = 0. 

The characteristic equation is s 2 + 3s- + 2 = 0 and has zeros s = — 1 and s = 
—2. There are thus no zeros on the imaginary axis and hence there are no periodic 
eigenfunctions, let alone periodic eigenfunctions with period 2n. As a consequence, 
there is exactly one periodic solution y(t) with period 2n. This can be determined as 
follows. We consider the differential equation as an LTC-system with input u(t) = 
cos t. Applying (5.4) gives the frequency response of the system: 

Him) = --- 

2 + 3 ia> — a> 2 
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Filter 


Since u(t) = (e" + e~' r )/2, it is a linear combination of time-harmonic signals 
whose response can be found using the frequency response calculated above: e u h > 
H(i)e lt ande _,f \-r H(— l)e~ 1 '. Hence, 


H(l)e u + H{-\)e~ H 
cos t t-r - 


2(1 + 3 i) + 2(1 - 3i) 

1 

— (cost + 3 sint). 


◄ 


In general we will consider stable systems. When a stable system is described 
by a differential equation of type (5.3), then one can prove (see chapter 10) that the 
real parts of the zeros of the characteristic polynomial are always negative. In other 
words, the zeros lie in the left-half plane of the complex plane and hence, none of 
the zeros lie on the imaginary axis. Then A(ia> ) ^ 0 for all to and on the basis 
of theorem 5.2 H (a>) then exists for all to. Using theorem 5.1 one can thus determine 
the line spectrum of the response for any periodic input. 

Systems like electrical networks and mechanical systems are described by differ¬ 
ential equations of the form (5.3) with the coefficients oq, «],..., a m and bo , b\, 
being real numbers. The response to a real input is then also real. In chap¬ 
ter 1. section 1.3.4, we have called these systems real systems. A sinusoidal signal 
A cos(a>t + <j> o) with amplitude A and initial phase </>q, for which the frequency to is 
equal to an eigenfrequency of the system is then an eigenfunction. If the sinusoidal 
signal is not an eigenfunction, then A(ito) ^ 0 and so H(co ) exists. In section 1.3.4 
we have seen that the response of a real system to the sinusoidal signal then equals 

A | H(to) | cos (tot + <j>o + 4>(a>)). 

The amplitude is distorted with the factor | H(to) |, which is the amplitude response 
of the system, and the phase is shifted over <T(a>) = arg H(a>), which is the phase 
response of the system. Now an arbitrary piecewise smooth, real and periodic input 
can be written as a superposition of these sinusoidal signals: 

oo 

u(t) = E A n cos(na>ot + (/>„). 

n=0 

On the basis of the superposition rule, the response y{t) of a stable LTC-system is 
then equal to 

oo 

y(t) = Ah I H(ruoo) | cos(nw 0 t + 0„ + <J>(/ta> 0 )). 

n =0 

Depending on the various frequencies contained in the input, amplitude distortions 
and phase shifts will occur. 

If H{na>o) = 0 for certain values of n, then we will say that the frequency na>o 
is blocked by, or will not pass, the system. Designing electrical networks with 
frequency responses that meet specific demands, or, put differently, designing filters, 
is an important part of network theory. Examples are low-pass filters, blocking 
almost all frequencies above a certain limit, high-pass filters, blocking almost all 
frequencies below a certain limit, or more general, band-pass filters, through which 
only frequencies in a specific band will pass. 

We close this section with some examples. 


EXAMPLE 5.4 


In figure 5.1 an electrical network is drawn, which is considered as an LTC-system 
with input the voltage across the voltage generator and output the voltage across the 
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FIGURE 5.1 
An RC-network. 


EXAMPLE 5.5 


capacitor. The corresponding differential equation reads as follows: 

RCy'(t) + y{t) — u(t). 

The characteristic equation RCs +1 = 0 has one negative zero. The system is stable 
and has frequency response 


H(co) = 


1 

itoRC + 1 


Now let the sinusoidal input with frequency a> and initial phase <f>Q be given by 
u(t) = a cos(a>f + tf>o). In order to determine the response, we need the modulus 
and argument of the frequency response. Using the notation RC = r one obtains 
that 


I H{w) | = 


1 


1 


iu>x + 1 

arg(//(a>)) = — argO'wr + 1) = — arctan(wr). 


y /1 + 0> 2 T 2 


The response of the system to u(t) is thus 
a 

y(t) = — cos(«f — arctan(coT) + 4>q). 

V 1 + w 2 t 2 

As we can see, the amplitude becomes small for large a>. One could consider this 
network as a low-pass filter. ^ 


In figure 5.2 a simple mechanical mass-spring system is drawn. An external force. 



V 

m 


A 

_ 


Fit) = u(t) 

/\mw+w 






0 



FIGURE 5.2 

A simple mechanical mass-spring system. 

the input u(t), acts on a mass m, which can move in horizontal direction to the left 
and to the right over a horizontal plane. A spring V connects m with a fixed point A. 
Furthermore, a frictional force W acts on m. The displacement y(t) is considered 
as output. The force that the spring exerts upon the mass m equals — cy(t ) (c is 
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EXAMPLE 5.6 


the spring constant). The frictional force is equal to —ay'(t). The corresponding 
differential equation is then 

u(t ) = my”(t) + ay'{t ) + cy{t), 

having as characteristic equation ms- TasTc = 0. Fora > 0, the roots are real and 
negative or they have a negative real part —a/2m. We are then dealing with a stable 
system. If, however, a = 0, then the system has an eigenfrequency a> r = sfcjm and 
a periodic eigenfunction with frequency co r , and so the system is no longer stable. 
The response to the periodic input cos (co r t) is not periodic. Resonance will then 
occur. ^ 

As a final example we treat an application of Parseval’s identity for periodic 
functions. 

The electric network from figure 5.3 is considered as an LTC-system with input 
the voltage u(t) across the voltage generator and output the voltage y(t) across the 
resistor. In this network the quantities C, L, R satisfy the relation R — L/C. The 


L 



FIGURE 5.3 

Electric network from example 5.6. 


relation between the input u(t) and the corresponding output y(t ) is given by 
y" - (2 /RC)y' + (1 /LC)y = u" - ( l/LC)u. 


The frequency response follows immediately from (5.4). If we put a = 1 /RC, then 
it follows from R = L/C that or = 1/LC and so 


H(co) = 


( ico) 2 — a 2 
(ico) 2 — 2 iaco + a 2 


im + a 
ico — a 


If u(t) is a periodic input with period T and line spectrum u n , then, owing to 
| a + ib | = | a — ib |, the amplitude spectrum | y n \ of the output is equal to 


\y n \ = \H(ncoo)u„ | = 


into o + a 
~ u n 

incoQ — a 



into o + a 


incD o — cl 


I Un I — I Un | . 


Apparently, the amplitude spectrum is not altered by the system. This then has 
consequences for the power of the output. Applying Parseval’s identity for periodic 
functions, we can calculate the power P of y(t) as follows: 


1 rT oo oo 

p =j | y(t) \ 2 dt = J2 l^l 2 = E l“"l 2 

■'h n=—oo n=—oo 



| u(t) | 2 dt. 


All-pass system 


We see that the power of the output equals the power of the input. Systems having 
this property are called all-pass systems (see also chapter 10). ^ 
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5.1 

5.2 


5.3 


5.4 


5.5 


5.6 


EXERCISES 


A stable LTC-system is described by a differential equation of the form (5.3). Let 
x{t) be an eigenfunction of the system. Show that lim^oo x (?) = 0. 


For an LTC-system the relation between an input u(t) and the corresponding re¬ 
sponse y(t) is described by y' + y — u. Let u(t ) be the periodic input with period 
2 n, which is given on the interval (— jt, n) by 


u(t) 


' for 1 1 1 < 7t/ 2, 
0 for 1 1 1 > jr/2. 


Calculate the line spectrum of the output. 


For an LTC-system the frequency response H ( co) is given by 


H(w) = 


1 for | co | < jt, 
0 for | w | > jt. 


a Can the system be described by an ordinary differential equation of the form 
(5.3)? Justify your answer. 

b We apply the periodic signal of exercise 5.2 to the system. Calculate the power 
of the response. 


To the network of example 5.6 we apply the signal u(t ) = | sin t | as input. Calculate 
the integral (1 /jt) Jq y (t) dt of the corresponding output y(t). This is the average 
value of y(t) over one period. 


For an LTC-system the relation between an input u(t) and the output y(t) is de¬ 
scribed by the differential equation 


y" + 2y' + 4y = u" + u. 

a Which frequencies do not pass through the system? 
b Calculate the response to the input u(t) = sint + cos 2 2 1. 


Given is the following differential equation: 

y" + co^y = u with | o>q I 7 ^ 0, L 2. 

Here u ( t ) is the periodic function with period 2n given by 


I t + jt for — jt < t < 0 , 

—t + jc for 0 < t < n. 


Does the differential equation have a unique periodic solution v(?) with period 27T? 
If so, determine its line spectrum. 


5.2 Partial differential equations 

In this section we will see how Fourier series can be applied in solving partial dif¬ 
ferential equations. For this, we will introduce a method which will be explained 
systematically by using a number of examples wherein functions u(x, t) occur, de¬ 
pending on a time-variable t and one position-variable x. However, this method can 
also be applied to problems with two, and often also three or four, position-variables. 
Here we will confine ourselves to the simple examples of the one-dimensional heat 
equation and the one-dimensional wave equation. 
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Heat equation 


Diffusion equation 

EXAMPLE 5.7 


Boundary condition 


5.2.1 The heat equation 


In Fourier’s time, around 1800. heat conduction was already a widely studied phe¬ 
nomenon, from a practical as well as from a scientific point of view. In the industry 
the phenomenon was important in the use of metals for machines, while in science 
heat conduction was an issue in determining the temperature of the earth’s interior, 
in particular its variations in the course of time. The first problem that Fourier (1761 
- 1830) addressed in his book Theorie analytique de la chaleur from 1822 was the 
determination of the temperature T in a solid as function of the position variables 
x, y, z and the time t. From physical principles he showed that the temperature 
T{x,y,z, t ) should satisfy the partial differential equation 

dT _ ld 2 r d 2 r a 2 r\ 

3 1 y dx 2 3 y 2 dz 2 ) 


Here k is a constant, whose value depends on the material of the solid. This equa¬ 
tion is called the heat equation. The same equation also plays a role in the diffusion 
of gases and liquids. In that case the function T(x, y, z, t ) does not represent tem¬ 
perature, but the local concentration of the diffusing substances in a medium where 
the diffusion takes place. The constant is in that case the diffusion coefficient and 
the equation is then called the diffusion equation. We now look at the equation in a 
simplified situation. 


Consider a thin rod of length L with a cylinder shaped cross-section and flat ends. 
The ends are kept at a temperature of 0° C by cooling elements, while the side- 
surface (the mantle of the cylinder) is insulated, so that no heat flows through it. At 
time t = 0 the temperature distribution in the longitudinal direction of the rod (the 
.r-direction; see figure 5.4) is given by a function f(x). So for fixed value of x, the 
temperature in a cross-section of the rod is the same everywhere. This justifies a 
description of the problem using only x as a position variable. The variables y and z 
can be omitted, and so we can consider the temperature as function of x and t only: 
T = T(x,t). The preceding equation then changes into 

3 T d 2 T 

— = k —7T for 0 < x < L and t > 0. 

3 1 dx 2 

We call this partial differential equation the one-dimensional heat equation. 

In the remainder of this chapter we will denote the function that should satisfy a 
partial differential equation by u(x. t). For the partial derivatives we introduce the 
following frequently used notation: 


3 u 

7 , = “x> 

dx 


3 2 u 


dx 2 ~ UxX ' 3 1 ~- dt 2 

With this notation the one-dimensional heat equation looks like this: 


du 

— = Ut, 

dt 


3 2 u 


= u tt . 


(5.7) 


Uf = ku xx for 0 < x < L and t > 0. 


(5.8) 


Since the temperature at both ends is kept at 0° C for all time, starting front t = 0, 
one has the following two boundary conditions: 

u(0, t) = 0, u(L,t) — 0 fort>0. (5.9) 


Initial condition 


Finally we formulate the situation for t = 0 as an initial condition : 
u(x, 0) = f{x) for 0 < x < L. 


(5.10) 
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Linear homogeneous 
condition 


Formal solution 
Step 1 



FIGURE 5.4 

Thin rod with temperature distribution f{x) at t = 0. 

Here f(x) is a piecewise smooth function. This situation is shown in figure 5.4. The 
partial differential equation (5.8) is an example of a linear homogeneous equation. 
That is to say, when two functions u(x, t) and v(x, t) satisfy this equation, then so 
does any linear combination of these two functions. In particular the null-function 
satisfies the equation. The boundary conditions (5.9) have the same property (verify 
this). This is why these conditions are also called linear homogeneous conditions. 
Constructing a solution of equation (5.8) satisfying conditions (5.9) and (5.10) will 
consist of three steps. In the first two steps we will be using separation of vari¬ 
ables to construct a collection of functions which satisfy (5.8) as well as the linear 
homogeneous conditions (5.9). To this end we must solve a so-called eigenvalue 
problem, which will take place in the second step. Next we construct in the third 
step, by means of an infinite linear combination of the functions from this collection, 
or, put differently, by superposition , a solution which also satisfies the inhomoge¬ 
neous condition (5.10). In this final step the Fourier series enter, and so we will have 
to deal with all kinds of convergence problems. If we ignore these problems during 
the construction, then it is said that we have obtained a formal solution, for which, 
in fact, one still has to show that it actually is a solution, or even a unique solution. 

Separation of variables 

Using separation of variables we will construct a collection of functions satisfying 
the partial differential equation (5.8) and the linear homogeneous conditions (5.9) 
and having the form 

u{x, t) = X(x)T{t), (5.11) 

where X (x) is a function of x only and T (t) is a function of t only. If we substitute 
(5.11) into (5.8), then we obtain the relation 

X(x)Tft) = kX" (x)T(t). 

After a division by kX{x)T(t) the variables jc and t are separated: 

T\t) = X"{x) 
kT(t) X(x) ' 
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Eigenvalue 

Eigenfunction 

Step 2 


Here the left-hand side is a function of t and independent of x, while the right-hand 
side is a function of x and independent of t. Therefore, an equality can only occur 
if both sides are independent of x and t, and hence are equal to a constant. Call this 
constant c, then 

T'(t) = X"{x) 

kT(t) X(x) 

The constant c is sometimes called the constant of separation. We thus have 

X"(x)-cX(x) = 0, (5.12) 

T'(t) — ckT (r) = 0. (5.13) 

Substitution of (5.11) into the linear homogeneous boundary conditions (5.9) gives 
u( 0, r) = X(0)T(t) = 0 and u(L, t) = X(L)T(t ) = 0 for t > 0. We are not 
interested in the trivial solution T(t) = 0 and so (0) = 0 and X(L) = 0. Together 
with (5.12) this leads to the problem 

X" -cX = 0 for 0 < x < L, X(0) = 0, X(L) = 0. (5.14) 

where X(x) and c are to be determined. First we will solve problem (5.14) and 
subsequently (5.13). Problem (5.14) obviously has the trivial solution X(jt) = 0, 
which is of no interest. We are therefore interested in those values of c for which 
there exists a non-trivial solution X(x). These values are called eigenvalues and 
the corresponding non-trivial solutions eigenfunctions. Determining the eigenvalues 
and their corresponding eigenfunctions is the second step in our solution method. 

Calculating eigenvalues and eigenfunctions 

When we try to solve problem (5.14) we have to distinguish two cases, namely c/0 
and c = 0. 

a For c = 0 equation (5.14) becomes X" = 0, which has general solution X(x) = 
ax + ft. From the boundary conditions it follows that X(0) = f = 0 and X(L) — 
aL = 0. Hence, f) = a = 0. We then obtain the trivial solution and this means that 
c = 0 is not an eigenvalue. 

b For c ^ 0 the characteristic equation s~ — c = 0 corresponding to (5.14) has 
two distinct roots sj and S 2 with S 2 — —si . Note that these roots may be complex. 
The general solution is then 

X(x) = ae six + fe~ six . 

The first boundary condition 3((0) = 0 gives a + f) = 0, so f = —a. Next we 
obtain from the second boundary condition X(L) = 0 the equation 

a(e slL -e~ s ' L ) =0. 

For a = 0 we get the trivial solution again. So we must have e S{L — e~ SlL = 0, 
implying that e 2siL = 1. From this it follows that = inn/L, where n is an integer 
and n 0. This gives us eigenvalues c = s^ = — (nn/Lff. The corresponding 
eigenfunction X(jt) is X(x ) = 2 ia sin(nnx/L). However, since a is arbitrary, we 
can say that eigenvalue c = —( nn/L ) 2 corresponds to the eigenfunction 

X n (x ) = sin (nnx/L), 

where we may now assume that n is a positive integer. 

For c = —(nn/L)- the first-order differential equation (5.13) has the fundamen¬ 
tal solution 

T n (t) = e —( n7l /L) 2 kt' 
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Fundamental solution 


Step 3 


EXAMPLE 5.8 


We have thus found the following collection of fundamental solutions satisfying 
equation (5.8) and conditions (5.9): 

u n (x, t) = T n (t)X n {x) = e~ n 71 kr / L sin(/t7r x/L) forn = 1,2,.... (5.15) 


Superposition of fundamental solutions 

Since (5.8) is a linear homogeneous differential equation and (5.9) are linear ho¬ 
mogeneous conditions, it is possible to take linear combinations of fundamental 
solutions, or, as it is often put by scientists, to form new solutions of (5.8) and (5.9) 
by superpositions. Each finite linear combination a\u\ + < 221/2 + • • • + a n ii n of 
fundamental solutions also satisfies (5.8) and (5.9). However, in general we cannot 
expect that a suitable finite linear combination will give us a solution which also 
satisfies the remaining inhomogeneous condition. We therefore try an infinite linear 
combination of fundamental solutions, still called a superposition of fundamental 
solutions. It has the form 
00 

u{x,t) = n s'm{nnx/L). (5.16) 

n=l 

If this superposition is to satisfy the inhomogeneous condition (5.10), then u(x, t) 
should be equal to the function fix) for t = 0 and hence 

00 

uix, 0) = E A n sm(nnx/L) = f(x) forO < x < L. 

n= 1 


The coefficients A n can thus be found by determining the Fourier sine series of 
fix). The result is 


An 



fix) sin (nnx/L) dx. 


Substitution of these coefficients in (5.16) finally gives us a formal solution of the 
heat conduction problem. Since we required fix) to be piecewise smooth, and we 
also assumed that fix) equals the average value of the left- and right-hand limit 
at jumps, fix) is equal to the sum of its Fourier sine series on the interval [0, L\. 
Hence, uix, 0) = fix). It it also easy to see that for x = 0 and x = L the sum of 
the series in (5.16) equals 0, since all terms are 0 then. The homogeneous conditions 
are thus also satisfied. To show, however, that the series (5.16) also converges for 
other values of y and t > 0, and that its sum uix, t) satisfies differential equation 
(5.8), requires a detailed analysis of the convergence of the series in (5.16). We 
will content ourselves here with stating that in the case when fix) is piecewise 
smooth, one can prove that uix, t) found in this way is indeed a solution of the heat 
conduction problem that we have posed, and even that it is the unique solution. ^ 


In the preceding example the temperature at both ends of the rod was kept at 0° C. 
This resulted in linear homogeneous conditions for the heat conduction problem. 
We will now look at what happens with the temperature of a rod whose ends are 
insulated. 


Insulation of the ends can be expressed mathematically as u x (0, t) = 0 and 
u x iL, t) = 0. The heat conduction problem for this rod is thus as follows: 

uj = ku xx for 0 < x < L, t > 0, 

u x (0, t) = 0. u x iL, t) — 0 for t > 0, 
uix, 0) = fix) for 0 < x < L. 



5.2 Partial differential equations 


127 


EXAMPLE 5.9 


Wave equation 


Going through the three steps from example 5.7 again, we find a difference in step 
1: instead of problem (5.14) we obtain the problem 

X" - cX = 0 for 0 < x < L, 

X'(0) = 0, X'(L) = 0. 

For c = 0 we find that X(x) is a constant. So now c = 0 is an eigenvalue 
as well, with eigenfunction a constant. For c ^ Owe again find the eigenval¬ 
ues c — —(nn/L)- with corresponding eigenfunctions X n (x ) = cos(n7r x/L) for 
n = 1,2.Hence, the eigenfunctions are 

X n (x ) = cos(nnx / L) for n = 0, 1,2, 3. 

Note that n now starts from n = 0. The remainder of the construction of the col¬ 
lection of fundamental solutions is entirely analogous to the previous example. The 
result is the collection of fundamental solutions 

u n (x, t) = e~ n 77 cosinnx/L) forn = 0, 1 , 2, .... 


Superposition of the fundamental solutions in step 3 gives 

o° , 2 , 

u(x,t) = ^Aq + A n e~ n 71 cosinnx/L). 

n =t 


Since u(x, 0) = f{x) for 0 < x < L, the coefficients A n are equal to 


An 



f{x) cosinnx/L) dx 


for n = 0, 1,2, 3. 


These Fourier coefficients arise by determining the Fourier cosine series of fix). 
Substitution of these coefficients in the series for u(x, t) then gives a formal solution 
again. Since f(x) is piecewise smooth, one can prove once more that this is a unique 
solution. ^ 

If we look at the solution for t —> oo, then all terms in the series for u(x, t) tend 
to 0, except for the term Ag/2. One can indeed prove that lim f _ s . 00 u(x, t) = Aq/2. 
It is then said that in the stationary phase the temperature no longer depends on t 
and is everywhere equal to the average temperature 


Ap 

2 


i r L 

- / / (x) dx 

L Jo 


at t = 0 on the interval [0, L], Figure 5.5 illustrates this result. 


5.2.2 The wave equation 

We now consider the example of a vibrating string of length L and having fixed ends. 
Just as in the heat conduction problem, we will not discuss the physical arguments 
needed to derive the wave equation. 

The equation describing the vertical displacement u(x, t) of a vibrating string is 

9 

utt = a u xx forO < x < L, t > 0. (5.17) 

Here a is a constant which is related to the tension in the string. This equation is 
called the wave equation. Since the ends of the string are fixed, one has the following 
boundary conditions: 

u(0, t) = 0, u(L,t) = 0 forr>0. (5.18) 



128 


5 Applications of Fourier series 



FIGURE 5.5 

Temperature distribution in a rod with insulated ends. 



FIGURE 5.6 

Displacement of a vibrating string. 


In figure 5.6 we see the displacement of the string at time t = 0. We thus have the 
initial condition 

u(x, 0) = f(x) for 0 <x <L. (5.19) 

Moreover, it is given that at t = 0 the string has no initial velocity. So as a second 
initial condition we have 


u r (x , 0) = 0 for 0 < x < L. 


(5.20) 
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Step 1 


Step 2 


Analogous to the heat conduction problem in a rod we will derive a formal solution 
in three steps. 

Separation of variables 

We first determine fundamental solutions of the form u(x, t) — X(x)T ( t ) that sat¬ 
isfy the partial differential equation and the linear homogeneous conditions. Substi¬ 
tution of u{x , t) = X(x)T(t) into (5.17) gives XT" = a 2 X"T. Dividing by a 2 XT 
leads to 

T" _ X" _ 

~ffr ~ ~x ~ c ' 

where c is the constant of separation. From this we obtain the two ordinary differ¬ 
ential equations 

X"-cX = 0, T"-ca 2 T = 0. (5.21) 


Conditions (5.18) and (5.20) are linear homogeneous conditions. Substitution of 
u(x, t) = X(x)T(t ) in condition (5.18), and using that u(x, t) should not be the 
trivial solution, leads to the conditions X(0) =0 and X(L) = 0. Subsequently 
substituting u(x, t) = X(x)T(t) in condition (5.20) gives the relation T'(0)X (.r) = 
0 for 0 < x < L. Hence T'( 0) = 0. 

Calculating eigenvalues and eigenfunctions 

For the function X (x) we derived in step 1 the following differential equation with 
boundary conditions: 

X" -cX = 0 for 0 < x < L, 

X (0) = 0, X(L) = 0. 


So here we again find the eigenvalues c = — ( nn/L) 2 for n — 1,2,... and the 
corresponding eigenfunctions 

X n (x) = sin(nnx/L) forn = 1, 2, 3, .... 


In order to find the fundamental solutions we still have to determine T (f). From the 
eigenvalues we have found, we obtain from (5.21) the differential equation 


T + 


n-7t~a~ 


iff 


-T = 0. 


Its general solution is 


T{t) = a cos(nnat/L) + ft sin (nnat/L), 

which has as derivative 
, ntta 

T (t) = —j— (— a sm{nnat/L) + f cos(nnat/L)). 

Substitution of the condition jT / ( 0) = 0 gives f = 0 and so we obtain for the 
eigenvalue —(njr/L) 2 the following fundamental solution: 


T n (t) = cos(nnat/L) forn = 1, 2, 3, .... 

We have thus found the following fundamental solutions: 

u n (x, t ) = T n (t)X n (x) = cos (nnat/L) sin (nnx/L) for n = 1, 2, 3,.... 
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Step 3 


5.7 


5.8 


5.9 


Superposition 

Superposition of the fundamental solutions gives the series 

oo 

u(x, t) = E A„ co&innat / L) sin (nnx/L). (5.22) 

n= 1 

By substituting the remaining initial condition (5.19), a Fourier series arises: 

oo 

u(x, 0) = fix) = E A n sin{nnx/L) forO < x < L. 

n= 1 

For the Fourier coefficients A n one thus has 
2 f L 

A n = — / f{x)sm(nrcx/L)dx. 

L Jo 

The series (5.22) together with these coefficients give the formal solution of our 
problem. One can indeed show that the formal solution thus obtained is the unique 
solution, provided that fix) is piecewise smooth. ^ 

In many cases the assumption of an initial velocity u t {x, 0) = 0 is artificial. This 
assumption made it possible for us to find a simple solution for T n it). For a string 
which is struck from its resting position, one takes as initial conditions uix, 0) = 0 
and itt (x , 0) = gix). When both the initial displacement and the initial velocity 
are unequal to 0, then we are dealing with a problem with two inhomogeneous con¬ 
ditions. As a consequence, the functions T n (t) will contain sine as well as cosine 
terms. We must then determine the coefficients in two distinct Fourier series. For 
detailed results we refer to Fourier series, transforms and boundary value problems 
by J. Flanna and J.H. Rowland, pages 228 - 233. In the same book, pages 219 - 227, 
one can also find the derivation of the wave equation and the heat equation, as well 
as the verification that the formal solutions constructed above are indeed solutions, 
which moreover are unique. 


EXERCISES 


A thin rod of length L with insulated sides has its ends kept at 0° C. The initial 
temperature is 


uix, 0 ) 


x for 0 < x < L /2, 

L — x for L/2 < x < L. 


Show that the temperature uix, t) is given by the series 


uix , ( )Ef JzHE e -(2«+DVwL2 si 

JZ 2 ^' (2« + l) 2 


Both ends and the sides of a thin rod of length L are insulated. The initial tem¬ 
perature of the rod is uix, 0) = 3 cosi8nx/L). Write down the heat equation for 
this situation and determine the initial and boundary conditions. Next determine the 
temperature uix, t). 

For a thin rod of length L the end at x = L is kept at 0° C, while the end at x = 0 
is insulated (as well as the sides). The initial temperature of the rod is u)x, 0) = 
7 cos(5jt.v/2L). Write down the heat equation for this situation and determine the 
initial and boundary conditions. Next determine the temperature uix, t). 
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5.10 


5.11 


5.12 


5.13 


5.14 


5.15 


Determine the solution of the following initial and boundary value problem: 

Uf = u xx for 0 < x < 2, t > 0, 

u x ( 0 , t ) = 0, i/(2, /) = 0 forf > 0, 


u(x, 0) 


1 for 0 < x < 1, 

2 — x for 1 < x < 2. 


A thin rod of length L has initial temperature ;<(.*, 0) = /(.*). The end at x = 0 is 
kept at 0° C and the end at x = L is insulated (as well as the sides). Write down the 
heat equation for this situation and determine the initial and boundary conditions. 
Next deteimine the temperature u(x, t). 

Determine the displacement u(x, t ) of a string of length L, with fixed ends and 
initial displacement u(x, 0) = 0.05 sin {Anx/L). At time t = 0 the string has no 
initial velocity. 

A string is attached at the points x = 0 and x = L and has as initial displacement 


| 0.02.V for 0 < x < L/2, 

! “ { 0.02 (L - x) for L/2 < x < L. 

At time t = 0 the string has no initial velocity. Write down the corresponding initial 
and boundary value problem and determine the solution. One could call this the 
problem of the ‘plucked string": the initial position is unequal to 0 and the string is 
pulled at the point x = L /2, while the initial velocity is equal to 0. 

A string is attached at the points x = 0 and x = 2 and has as initial displacement 
u(x, 0) = 0. The initial velocity is 


u t (x, 0) = g(x) = 


0.05.V for 0 < x < 1, 

0.05(2 — x) for 1 < x < 2. 


Write down the corresponding initial and boundary value problem and determine 
the solution. This problem could be called the problem of the ‘struck string": the 
initial position is equal to 0, while the initial velocity is unequal to 0, and the string 
is struck at the midpoint. 

Deteimine the solution of the following initial and boundary value problem, where 
k is a constant: 

u t = a~u xx for 0 < x < n, t > 0, 

u x (0, t) = 0, u x Tt, t) = 0 for t > 0, 

Ut(x, 0) = 0, u(x , 0) = kx for 0 < x < tc . 


SUMMARY 

In this chapter Fourier series were first applied to determine the response of an LTC- 
system to a periodic input. Here the frequency response, introduced in chapter 1, 
played a central role. It determines the response to a time-harmonic input. Since the 
input can be represented as a superposition of time-harmonic signals, using Fourier 
series, one can easily determine the line spectrum of the output by applying the 
superposition rule. This line spectrum is obtained by multiplying the line spectrum 
of the input with the values of the frequency response at the integer multiples of the 
fundamental frequency of the input: 


)’n = H(na) 0 )u„. 
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5.16 


Here y n is the line spectrum of the output y(t), u lt the line spectrum of the input 
u(t), H(a>) the frequency response, and o>q the fundamental frequency of the input. 
For real inputs and real systems the properties of the time-harmonic signals are taken 
over by the sinusoidal signals. 

Systems occurring in practice are often described by differential equations of the 
form 

d m y d m ~ l y d n u d n ~ l u 

Clip] - -|- Clyy, _1 -7" • • • “I - ClO V - br] - “h by] _1 -7" • • • “I - 

dt rn T m 1 dt , n _ l T T U r rff „ t n I t 0 

In order to determine a periodic solution y(t) for a given periodic signal u(t), it is 
important to know whether or not there are any periodic eigenfunctions. These are 
periodic solutions of the homogeneous differential equation arising from the dif¬ 
ferential equation above by taking the right-hand side equal to 0. Periodic eigen¬ 
functions correspond to zeros s = ia> of the characteristic polynomial A(s) = 
a m s m + a m -is m ~ 1 + • • • + a q, and these lie on the imaginary axis. When the 
period of a periodic input coincides with the period of a periodic eigenfunction, 
then resonance may occur, that is, for a given u(t) the differential equation does not 
have periodic solutions, but instead unbounded solutions. 

When the differential equation describes a stable system, then all zeros of A(s) 
lie in the left-half plane and the frequency response is then for all co equal to 


H(co) = 


B(iai) 
A(ia >) ’ 


with B(s) — b n s n +b n _[S n ~ l + ■ ■ - + bQ. For real systems this means that there are 
no sinusoidal eigenfunctions, that is, no sinusoidal signals with an eigenfrequency. 

Secondly, Fourier series were applied in solving the one-dimensional heat 
equation 


ut — kiixx , 

and the one-dimensional wave equation 

2 

litt — a U\- \. 

Using the method of separation of variables, and solving an eigenvalue problem, 
one can obtain a collection of fundamental solutions satisfying the partial differen¬ 
tial equation under consideration, as well as the corresponding linear homogeneous 
conditions, but not yet the remaining inhomogeneous condition(s). By superposi¬ 
tion of the fundamental solutions one can usually construct a formal solution which 
also satisfies the inhomogeneous condition(s). In most cases the formal solution is 
the solution of the problem being posed. In the superposition of the fundamental so¬ 
lutions lies the application of Fourier series. The fundamental solutions describe, in 
relation to one or several variables, sinusoidal functions with frequencies which are 
an integer multiple of a fundamental frequency. This fundamental frequency already 
emerges when one calculates the eigenvalues. The superposition is then a Fourier 
series whose coefficients can be determined by using the remaining inhomogeneous 
condition(s). 


SELFTEST 

For the frequency response of an LTC-system one has 
H(co) = (1 - e~ 2im ) 2 . 
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5.17 


5.18 


5.19 


5.20 


5.21 


a Is the response to a real periodic input real again? Justify your answer, 
b Calculate the response to the input u(t) = sinfcuoO- 
c What is the response to a periodic input with period 1 ? 

For an LTC-system the relation between an input u(t) and the corresponding output 
y(t) is described by the differential equation y" + Ay' + Ay = u. Let u(t) be the 
periodic input with period 2 n, given on the interval (— jv, tv) by 

I nt + t~ for — n < t < 0, 
u(t) = I 7 r 

| jit — t~ for 0 < t < jt. 

Determine the first harmonic of the output yit). 

For an LTC-system the relation between an input u(t) and the output y(t) is de¬ 
scribed by the differential equation y'" + y" + Ay' + 4y = u' + u. 
a Does the differential equation determine the periodic response to a periodic in¬ 
put uniquely? Justify your answer. 

b Let u{t) = cos 3t and y(t) the corresponding output. Calculate the power of the 
output. 

A thin rod of length L has constant positive initial temperature u(x, 0) = uq for 
0 < x < L. The ends are kept at 0° C. The so-called heat-flux through a cross- 
section of the rod at position xq (0 < xq < L) and at time t > 0 is by definition 
equal to — K u x Do ,t). Show that the heat-flux at the midpoint of the rod (xq = L/2) 
equals 0. 

Consider a thin rod for which one has the following equations: 


u t = ku xx for 0 < x < L, t > 0, 

n(0, t) = 0, u(L, t) = 0 for t > 0, 


u(x, 0) 


f a for 0 < x < L/2, 
{o for L/2 < x < L, 


where a is a constant, 
a Determine the solution u(x, t). 

b Two identical iron rods, each 20 cm in length, have their ends put against each 
other. Both of the remaining ends, at x = 0 and at x — 40 cm. are kept at 0° C. The 
left rod has a temperature of 100° C and the right rod a temperature of 0° C. Cal¬ 
culate for k = 0.15cm 2 s _1 the temperature at the boundary layer of the two rods, 
10 minutes after the rods made contact, and show that this value is approximately 
36° C. 

c Calculate approximately how many hours it will take to reach a temperature 
of 36° C at the boundary layer, when the rods are not made of iron, but concrete 
(k = 0.005 cm 2 s -1 ). 


Given is the following initial and boundary value problem: 

u n — a 2 u xx for 0 < x < L, t > 0, 

u( 0, t) — 0, u(L, t) = 0 for t > 0, 
u(x, 0) = sin (nx/L) forO < x < L, 

Uf{x , 0) = 7 sin(37rx/L) for 0 < x < L. 


Show that the first two steps of the method described in section 5.2 lead to the 
collection of fundamental solutions 


u n (x, t ) = ( A n s'm(njvat/L) + B n cos(nnat/L)) sinfntrx/L), 

and subsequently determine the formal solution which is adjusted to the given initial 
displacement and initial velocity. 




Part 3 

Fourier integrals and distributions 


INTRODUCTION TO PART 3 


In part 2 we have developed the Fourier analysis for periodic functions. To a periodic 
function fit) we assigned for each n e Z a Fourier coefficient c n e C. Using these 
Fourier coefficients we then defined the Fourier series, and under certain conditions 
on the function / this Fourier series converged to the function /. Schematically this 
can be represented as follows: 

periodic function /(f) with period T and frequency tOQ = 2n/T 

4 - 

1 / -r/2 _• , 

Fourier coefficients c n = — I f(t)e " ,a> ° r dt for n eZ 


oo 

Fourier series /(f) = ^ c n e" uo ° r . 

n——o o 

Often, however, we have to deal with non-periodic phenomena. In part 3 we now 
set up a similar kind of Fourier analysis for these non-periodic functions. To a non¬ 
periodic function we will assign for each to e R a number F(a >) e C. Instead of a 
sequence of numbers c n , we thus obtain a function F(to ) defined on R. The function 
F(to) is called the Fourier transform of the non-periodic function /(f). Next, the 
Fourier series is replaced by the so-called Fourier integral: instead of a sum over 
n € Z we take the integral over to e R. As for the Fourier series, this Fourier 
integral will represent the original function / again, under certain conditions on /. 
The scheme for periodic function will in part 3 be replaced by the following scheme 
for non-periodic functions: 

non-periodic function /(f) 


i 

/ oo 

f(t)e~ ia> 'dt for to e R 
-oo 

I 

Fourier integral/(f) = — / F(to)e ,0>t dto. 

~TC J_oo 
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We will start chapter 6 by showing that the transition from the Fourier series to 
the Fourier integral can be made quite plausible by taking the limit T -> oo of the 
period T in the theory of the Fourier series. Although this derivation is not mathe¬ 
matically correct, it does result in the right formulas and in particular it will show 
us precisely how the Fourier transform F(a >) should be defined. Following the for¬ 
mal definition of F(a>), we first calculate a number of standard examples of Fourier 
transforms. Next, we treat some fundamental properties of Fourier transforms. 

In chapter 7 the fundamental theorem of the Fourier integral is proven: a function 
f(t) can be recovered from its Fourier transform through the Fourier integral (com¬ 
pare this with the fundamental theorem of Fourier series from chapter 4). We finish 
the theory of the Fourier integral by deriving some important additional properties 
from the fundamental theorem, such as Parseval's identities for the Fourier integral. 

A fundamental problem in the Fourier analysis of non-periodic functions is the 
fact that for very elementary functions, such as the constant function 1, the Fourier 
transform F(u>) does not exist (we will show this in chapter 6). In physics it turned 
out that useful results could be obtained by a symbolic manipulation with the Fourier 
transform of such functions. Eventually this led to new mathematical objects, called 
‘distributions'. Distributions form an extension of the concept of a function, just as 
the complex numbers form an extension of the real numbers. And just as the com¬ 
plex numbers, distributions have become an indispensable tool in the applications of 
Fourier analysis in, for example, systems theory and (partial) differential equations. 
In chapter 8 distributions are introduced and some basic properties of distributions 
are treated. The Fourier transform of distributions is examined in chapter 9. 

Just as in part 2, the Fourier analysis of non-periodic functions and distributions 
is applied to the theory of linear systems and (partial) differential equations in the 
final chapter 10. 
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CHAPTER 6 


Fourier integrals: definition 
and properties 


INTRODUCTION 


We start this chapter with an intuitive derivation of the main result for Fourier in¬ 
tegrals from the fundamental theorem of Fourier series. A mathematical rigorous 
treatment of the results obtained is postponed until chapter 7. In the present chapter 
the Fourier integral will thus play a minor role. First we will concentrate ourselves 
on the Fourier transform of a non-periodic function, which will be introduced in 
section 6.2, motivated by our intuitive derivation. After discussing the existence of 
the Fourier transform, a number of frequently used and often recurring examples are 
treated in section 6.3. In section 6.4 we prove some basic properties of Fourier trans¬ 
forms. Subsequently, the concept of a ‘rapidly decreasing function' is discussed in 
section 6.5; in fact this is a preparation for the distribution theory of chapters 8 and 
9. The chapter closes with the treatment of convolution and the convolution theorem 
for non-periodic functions. 

LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know the definition of the Fourier transform 

- can calculate elementary Fourier transforms 

- know and can apply the properties of the Fourier transform 

- know the concept of rapidly decreasing function 

- know the definition of convolution and know and can apply the convolution 
theorem. 


6.1 An intuitive derivation 

In the introduction we already mentioned that in order to make the basic formu¬ 
las of the Fourier analysis of non-periodic function plausible, we use the theory of 
Fourier series. We do emphasize that the derivation in this section is mathemati¬ 
cally not correct. It does show which results are to be expected later on (in chapter 
7). It moreover motivates the definition of the Fourier transform of a non-periodic 
function. 

So let us start with a non-periodic function / : R —>• C which is piecewise 
smooth (see chapter 2 for ‘piecewise smooth’). For an arbitrary T > 0 we now 
consider the function fj(t) on the interval (— T/2 , T /2) obtained from / by taking 
/ equal to 0 outside this interval. The function values at the points — T/2 and 
T /2 are of no importance to us and are left undetermined. Next we extend fj (t ) 
periodically to R. See figure 6.1. In this way we obtain a function with period T 
to which we can apply the theory of Fourier series. Since this periodic function 
coincides with the original function / on {—T/2, T /2), one thus has, according to 
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FIGURE 6.1 

How a periodic function arises from a non-periodic function. 


the fundamental theorem of Fourier series (see theorem 4.3), 


/w= E 


c n e 


JnAcot 


2tc 

for t e (— T/2, T /2) and with Aft) = —, 


where c n is the nth Fourier coefficient of /. Instead of cog, used in part 2, we write 
A&j here. From the definition of c n it then follows that 

o° / i r T/2 \ 

f (0 = E U f(T)e-‘>' A ^dT e inAm > 

n^ooV J-T/2 ) 


and hence 


oo a f T/2 

/(0= E t I f(T)e inAco(t - r) d r, 

r j-t/2 


( 6 . 1 ) 


where always t e (-T/2, T/2). Of this last expression we would like to determine 
the limit as T —»■ oo, since in that case the identity will hold for all (el, giving us 
a result for the original non-periodic function /. Let us write 

/ oo 

f(T)e‘ a{, ~ z) dr , (6.2) 

-oo 

then 

— E C(nAco) ■ Ao) = —— E / f(r)e inAoj(l - t) dz (6.3) 

1 n=—oo n=—o o''— 00 

seems to be a good approximation for the right-hand side of (6.1). If we now let 
T -*■ oo, so Atu —> 0, then the left-hand side of (6.3) looks like a Riemann sum, 
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FIGURE 6.2 

An approximation of Gito) da> by YlnL—oo G(nAto) ■ A to. 


which will be a good approximation for 


1 f°° 

—— / G(to) dco. 

-tt J— OO 


(6.4) 


This is illustrated in figure 6.2. Formulas (6.2) and (6.4) combined suggest that for 
T —> oo the identity (6.1) will transform into 


fit) = ( r f(T)e- i0,T dr) e imt doo. (6.5) 

J— oo \J—oo I 

Formula (6.5) can be interpreted as follows: when a function f(z) is multiplied by 
a factor e~ l0>r and is then integrated over R, and when subsequently the resulting 
function of to is multiplied by e la>t and then again integrated over R, then, up to a 
factor 2rr, the original function / will result. 

This important result will return in chapter 7 as the so-called fundamental the¬ 
orem of the Fourier integral and it will also be proven there. This is because the 
intuitive derivation given here is incorrect in two ways. First, (6.3) is only an approx¬ 
imation of the right-hand side of (6.1) since G(nAco) is an integral over R instead 
of over (— jT/2, T /2), as was the case in the right-hand side of (6.1). Furthermore, 
the right-hand side of (6.3) may certainly not be considered as an approximating 
Riemann sum of the integral in (6.4). This is because if we consider the integral in 
(6.4) as an improper Riemann integral, then we recall that by definition this equals 

1 r b 

lim — / G(to)dto. 
a—>— oo,6—»oo 2n J a 


Flence, the integral over R is not at all defined through Riemann sums, but using the 
limit above. There is thus no real justification why (6.3) should transform into (6.4) 
for T —y oo. In chapter 7 we will see, however, that the important result (6.5) is 
indeed correct for a large class of functions. 


6.2 The Fourier transform 

Motivated by the results from the previous section we now define, for a function 
/ : R —>■ C, a new function F(to) (for to e R) by the inner integral in (6.5). 
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DEFINITION 6.1 

Fourier transform or 
spectrum 


Fourier transform 


Time domain 
Frequency domain 


Amplitude spectrum 
Phase spectrum 
Energy spectrum 
Spectral energy density 


EXAMPLE 6.1 

Unit step function 
Heaviside function 


For a given function f : R —*■ C the function F((d) (for co e R) is defined by 





f (t)e~‘ Mt dt. 


( 6 . 6 ) 


provided the integral exists as an improper Riemann integral. The function F(m) is 
called the Fourier transform or spectrum of f(t). 


Sometimes F(co) is called the spectral density of /(f). The mapping assigning 
the new function F(a>) to /(f) is called the Fourier transform. We will sometimes 
write (IF f)(ai) instead of F(ai), while the notation (Tf(t))(oj) will also be useful, 
though not very elegant. In the mathematical literature F(m) is usually denoted 
by f(a>). Often, /(f) will represent a function depending on time, while F(a>) 
usually depends on frequency. Hence, it is said that f(t) is defined in the time 
domain and that F(ai) is defined in the frequency domain. Since e~ lu>t is a complex¬ 
valued function, F(a>) will in general be a complex-valued function as well, so 
F : R —»■ C. Often F(at) is then split up into a real part and an imaginary part. One 
also regularly studies | F(at) |, the so-called amplitude spectrum (sometimes called 
spectral amplitude density) of /, and arg F(a>), the so-called phase spectrum of /. 
Finally, in signal theory one calls | F (at) | 2 the energy spectrum or spectral energy 
density of /(f). 

The definition of F(aT) closely resembles the one given for the Fourier coeffi¬ 
cients c n . Here, however, we take at e 1 instead of n e Z and in addition we 
integrate the function /(f) over R instead of over a bounded interval (of length one 
period). The fact that we integrate over R causes lots of problems. For the function 
f(t) = 1 on (— T /2, T /2) for example, one can determine the Fourier coefficients, 
while for the function /(f) = 1 on R the Fourier transform F(at) does not exist. 
The function introduced in our next example, re-appearing quite regularly, also has 
no Fourier transform. 


Let e(t) be the function defined by 


I 1 for f > 0, 

| 0 otherwise. 


See figure 6.3. This function is called the unit step function or Heaviside function. 
The Fourier transform of e(f) does not exist, because 


f 


e(t)e 


*dt = 


r 

Jo 


' dt = lim 


tm f 

-+00J o 


'dt. 


Since (e 


—l(Ot\f _ 


) = — icae 


(see example 2.11), it follows that 


f 


e(t)e 


dt = — : — lim 
—i(o A—>oo 


[•-l- 


lim e~ i(oA - 1 ) . 
a> Vri— >oo 



FIGURE 6.3 

The unit step function e(t). 
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DEFINITION 6.2 

Absolutely integrable 


Fourier integral 


Discrete or line spectrum 
Continuous spectrum 


However, the limit lim i 4 _ s>00 e ia>A does not exist, since lim j 4 _ s . 00 sin Aco (and also 
lim^-s.oo cos Aco) does not exist. ^ 


Next we introduce an important class of functions for which Fico) will certainly 
exist. 


A function f : R -*■ C is called absolutely integrable (on If) if j\ f(t) \ dt 
exists as an improper Riemann integral. 


When fit) is absolutely integrable and F(co) is as in (6.6), then 

” ' r ' 


I Fico) \ = \f f (t)e~ lm dt 

I J—O O 

COO 


< I I dt 

' —oo 1 


= f 1/(01 e~ imt dt, 

J— OO 


and since \e ,<ur | = 1 it then follows from definition 6.2 that 

/ oo 

| f(t) | dt < oo. 

-oo 


(6.7) 


This shows that Fico) exists when f(t) is absolutely integrable. Not all functions 
that we will need are absolutely integrable. This explains the somewhat weaker 
formulation of definition 6.1. 

On the basis of the intuitive result (6.5) we expect that for each r el the function 
value fft) can be recovered from the spectrum Fico) using the formula 

i r°° 

fit) = — / F(co)e uo, dco. (6.8) 

^ J —oo 


The right-hand side of (6.8) is called the Fourier integral of /. Formula (6.8) does 
however pose some problems. Even when fit) is absolutely integrable, F(co) need 
not be absolutely integrable. In section 6.3.1 we will see an example. On the other 
hand we can still make sense of (6.8), even if Fia>) has no improper Riemann in¬ 
tegral! And when the integral in (6.8) does exist (in some sense or other), then its 
value is not necessarily equal to fit). We will return to all of these problems in 
chapter 7. In the meantime we will agree to call the right-hand side of (6.8) the 
Fourier integral of fit), provided that it exists. In chapter 7 it will be shown that, 
just as for Fourier series, the Fourier integral does indeed exist for a large class of 
functions and that (6.8) is valid. 

If we now look at the Fourier series of a periodic function again, then we see 
that only integer multiples nAco of the frequency Aco = 2n/T occur (we write Aw 
here, instead of coq as used in part 2). In this case the spectrum is a function on Z, 
which is a so-called discrete set. Therefore, it is said that a periodic function has a 
discrete or line spectrum (see also section 3.3). However, in the Fourier integral all 
frequencies to occur, since we integrate over R. Hence, a non-periodic function leads 
to a continuous spectrum. Note, though, that this does not mean that the function 
F(co) is a continuous function, but only that Fico) depends on a continuous variable 


The transition from a discrete to a continuous spectrum can be illustrated quite 
nicely with the same sort of process as in section 6.1. Let / : R —>■ C be piecewise 
smooth and zero outside an interval i~T/2, T/2) (using the terminology of section 
6.1 we thus have frit) — fit))- Then the corresponding Fico) certainly exists, 
since we only integrate over the bounded interval (-T/2, T /2). If we now extend 
/ periodically, precisely as we did in section 6.1, then we can determine the Fourier 
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coefficients c„ (n e Z) of this periodic extension. Since the periodic extension coin¬ 
cides with / on (-T/2, T /2), and / itself is zero outside (— T /2, T /2), it follows 
that 

1 fT/2 . i roo . i 

Cn = - me-'^dt = - / f (t)e~ ,na>ot dt = —F(na>o), (6.9) 

T J-T/1 T J-oo T 

where oiq — 2n/T. We thus have 


Cn 

a > 0 


1 

— F{nm 0 ). 


Hence, if we ‘normalize’ the Fourier coefficients with the factor l/a>o, we obtain for 
ever increasing values of T, so for ever decreasing values of coq, an approximation of 
the function F(ct>)/2n that keeps improving. This is because we know the function 
values Final q) /27r at points that get closer and closer to each other. In figure 6.4 the 
functions | F(ai) \ I2n and | F(hcl>q) \ /2tr = c n /a>Q are represented for decreasing 
values of oiq. In the limit T oo, or cl>q —> 0, we thus indeed expect that the 
discrete spectrum will change into the continuous spectrum F(ai)/2n. 


EXERCISE 

6.1 Show that the function /(f) = 1 (for all (el) has no Fourier transform. 





FIGURE 6.4 

The normalized line spectrum approximates the continuous spectrum. 
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6.3 Some standard Fourier transforms 

In this section the Fourier transforms of a number of frequently used functions are 
determined. The most important results of this section are included in table 3 at the 
back of the book. 


6.3.1 The block function 


Block function 
Rectangular pulse function 


As a first example we consider for a fixed a > 0 the block function or rectangular 
pulse function p a (t) of height 1 and durations defined by 


Pail) = 


1 for 1 1 1 < a/2, 
0 otherwise. 


( 6 . 10 ) 


See figure 6.5. Note that p a {t) is certainly absolutely integrable. For at 0 one 
has 


(IF p a ) (to) = 


f 


Pa (; t)e 


*dt = 


ra/2 

J—a/2 


’ dt = 


a/2 
J —a [2 


giaat/2 _ e —iaw/2 2sin(flw/2) 


ICO 

while for co = 0 one has 

/ oo f a /2 

Pa(t)dt = 

-oo J—a/2 

From the well-known limit lim t _ j> o sinx/jc = 1 we obtain lim^^g (F p a )(at) = 
lim^^o 2 sm(aw/2)/a> = a. Although p a (t) is itself not continuous, we see that 


dt = a. 


(F p a ) (at) = 


2 sin(au)/2) 


( 6 . 11 ) 


is continuous on R. Also, Tp a is a real-valued function here. And finally we 
have that \\m ll) ^.± 00 (Fp a )(ot) = 0. All these remarks are precursors of general 
results to be treated in the chapters to come. In figure 6.5 we have sketched p a 
and Tp a . Finally we state without proof that the function g(x) = sin x/x (and so 
F(at) as well) is not absolutely integrable (see, for example, Fourier analysis by 


a b 



FIGURE 6.5 

The block function p a ( t) (a) and its spectrum (b). 
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T.W. Korner, Example 46.4). Hence, this is an example of an absolutely integrable 
function with a spectrum which is not absolutely integrable. 


Triangle function 


6.3.2 The triangle function 


For a fixed a > 0 the triangle function q a (t ) of height 1 and duration 2a is defined 
by 




a 


0 


for 1 1 1 < a. 
otherwise. 


( 6 . 12 ) 


See figure 6.6a. Note that q a (t) is absolutely integrable. We now have 


(Fq a )(co) = 


£ 


L 


q a (t)e 1<0t dt — / q a (t)e ,(or dt + 


£ 


q a (t)e 


' dt, 


and since q a (t) = q a (—t), we substitute u — —t in the second integral and subse¬ 
quently replace u by t again, which results in 


(fq a )(co) = q a (f)e~ lU>t dt + / q a {u)e' wu du 


=L 

-jf 


L 


0 

q a (t)(e~ Uot + e iM, )dt = 2 f 
JO 


cja(t) cos ft )t dt. 


From the definition of q a in (6.12) it then follows that 


i 


(3~q a )((i>) = 2 1 I 1-) cosw t dt. 

0 V a) 

For w = 0 we have cos cot = 1 and so 

-\a 


{Tq a m = 2 


1 

t - 1“ 

2 a 


= a. 


0 


For co f 0 it follows from integration by parts that 

FFqa)(co) = — f (l-) (sin oif )' dt 

to Jo \ a) 


1-I sin cut 


£, 

1 Jo 


-I-/ sin cot dt. 


JO aa> ■ 

since (1 — t jo)' = — 1/a. The first term in this sum is zero and so 


2 r a 

ato Jo 


2 2 

(J-q a )(oi) — — / sin cot cl t =-y [coscut]/ = —^-(1 — cosaw). 

acti 2 aco~ 


But 1 — cos aft) = 2 sin~(aft>/2), so 


{Tq a ){co) = 


4 sin 2 (aai/2) 
a co 2 


(6.13) 


As in the previous example, we have lim (0 ^o(^ r ?a)(<zi) = a, which means that 
Tq a is a continuous function on R. Again Tq a is a real-valued function here and 
lim (U _*.± 00 (fFqaflfo) = 0. In figure 6.6 q a and Tq a have been drawn. 
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a b 



The triangle function q a (t) (a) and its spectrum (b). 


6.3.3 The function e ' 


We will now determine the spectrum F(co) of the function f(t) = e~ a ^ I, where 
a > 0 is fixed. Since for fixed x, y e R one has ( e = (x + iy)e^ x+iy F (see 
example 2.11), it follows that 


F(co) = 


f 


'dt + 


f 

J — ( 


'dt 


g —(a+ico)t 
a + ico 


+ 


Jo 




Now lim^ 00 e“ (<!+, ' &;) ^ = e- aR e~ iloR = 0, since \e~ ia>R \ = 1 and 

lim^^jx, e~ aR = 0 fora > 0. Similarly one has lim^^._ 00 e ( a— <®) s = 0. Hence 


1 1 2 a 

F(m)=—— +-- = -=- j. (6.14) 

a -\- ico a — ico a 1 + co z 

Again F{co) is a continuous real-valued function with lim^^ioo F(co) = 0. 
Figure 6.7 shows /(f) and F(co). 


a b 
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Closely related to this example is the function g(t ) defined by 


*(*) = 


e ar for t > 0, 
0 otherwise, 


where a e C with Rea > 0. A convenient way of expressing g(f) uses the unit step 
function from example 6.1, since g(t) — e(t)e~ al . As before one quickly shows for 
g(t) that 


VJ Vu// — . —f) 9 • 

a -T i(o a- -T co~ 

The function G(u>) is now complex-valued. For a > 0 the function G(co ) has real 
parta/(a 2 + a> 2 ) = F(co)/2 and imaginary part co/(a~ +co 2 ). Note that co/(a 2 +co~) 
is not improper Riemann integrable. 


Gauss function 


6.3.4 The Gauss function 


To conclude, we determine the spectrum F(co) of the function /(f) = e~ at for 
fixed a > 0. The function /(f) is called the Gauss function. In order to determine 
F(co) directly from the definition, one would need a part of complex function theory 
which falls outside the scope of this book. There is, however, a clever trick to find 
F(co) in an indirect manner. To do so, we will assume the following fact: 


£ 


e x dx = sftz 


(6.15) 


(for a proof see for example Fourier analysis by T.W. Korner, Lemma 48.10). As 
a matter of fact, (6.15) also shows immediately that the function /(f) is absolutely 
integrable. Since /(f) = /(—f) it follows as in section 6.3.2 that 


F(a>) = 


-£ 


r dt = 2 


r 

Jo 


cos cot dt. 


We will now determine the derivative of F(a>). In doing so, we assume that the 
differentiation may be carried out within the integral. It would lead us too far to even 
formulate the theorem that would justify this step. The result of the differentiation 
with respect to co within the integral is as follows: 


te 


F'(co) = -2 f 

Jo 

Integrating by parts we obtain 

f'(co) = - r (, 

a Jo v 

= — ^e~ at sinwfj- 


sin cot dt. 


2 V 

1 sin cot dt 


r 

Jo 


—nt z 

e cos cot dt. 


The first term in this difference is equal to 0, while the second term equals —coF(co)/ 
2a. Hence we obtain for F(co) the (differential) equation 

F'(co) = (—co/2a)F(co). 

If we now divide left-hand and right-hand sides by F(co ), then 
F'(co) co . d 


F(co ) 


CO 

2 a ’ 


In | F (co) | = — —. 
cl co 2a 


that is. 
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But also at 2 /Aa) = —to/2a and thus apparently In | F(at) | = —or/4a + C 
for an arbitrary constant C. It then follows that 

| F(cd) | = e C e~ 0>2/4a . 

This in fact states that Fiat) = De~ c0 ! 4a , where D is an arbitrary constant (note 
that e c is always positive). If we substitute at = 0, then we see that D = F(0). 
Now change to the variable x = t^fa in (6.15), then it follows that 

D = F(0) = f°° e~ a,2 dt = -L [°° e~ (t ^ )2 V^dt = /—^. 

J—oo «/—oo V ^ 

The spectrum of the Gauss function is thus given by 

F(tu) = y^ e_ ® 2/4a - ( 6 - 16 ) 

This is again a continuous real-valued function with lintoj-^ioo F(w) = 0. It is 
quite remarkable that apparently the spectrum of e~ at is of the same form as 
the original function. For a = 1/2 one has in particular that (Te -1 '~)(ol>) = 
V / 2jre _ “ so up to the factor s/2ji exactly the same function. In figure 6.8 the 
Gauss function and its spectrum are drawn. 


a 


b 



FIGURE 6.8 

The Gauss function (a) and its spectrum (b). 


For the moment this concludes our list of examples. The most important results 
have been included in table 3. In the next section some properties of the Fourier 
transform are established, enabling us, among other things, to calculate more Fourier 
transforms. 


EXERCISES 

6.2 Consider for fixed a e C with Rea > 0 the function g(t) defined by g(f) = 

e{t)e~ at (also see section 6.3.3). 

a Show that for the spectrum G(ca) one has: G(a>) = (a — ia>)/(a 2 + at 2 ). 
b Take a > 0. Show that the Fourier integral for the imaginary part of G(at) (and 
hence also for G(at) itself) does not exist as an improper integral, 
c Verify that for the limit a —* 0 the function g(f) transforms into e(t), while 
G(at ) for at 0 transforms into —i /at. This seems to suggest that e (f) has the func¬ 
tion —i/at as its spectrum. This, however, contradicts the result from example 6.1. 
We will return to this in chapters 8 and 9 on distribution theory. 
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6.3 


6.4 


6.5 


THEOREM 6.1 

Linearity of the Fourier 
transform 


Determine the Fourier transform of the function 

_ | cos t for —n /2 <t< n /2, 

( 0 otherwise. 

Determine the spectrum G(u>) and verify that G(a>) is continuous when g(t) is given 
by 


| 1 1 1 for —1 < t < 1, 

,!> — ( 0 otherwise. 

a Let a > 0 be fixed. Determine the spectrum F(a>) of the function 

I I for 0 < t < a/2, 

— 1 for —a/2 < t < 0, 

0 otherwise. 

b Show that F(a>) is continuous at to = 0. 


6.4 Properties of the Fourier transform 

A large number of properties that we have established for Fourier series will return 
in this section. Often the proofs are slightly more difficult, since in Fourier analysis 
on R we always have to deal with improper (Riemann) integrals. The theory of im¬ 
proper integrals has quite a few difficult problems and we will not always formulate 
the precise theorems that will be needed. In section 6.3.4, for example, an improper 
integral and differentiation were ‘interchanged’, without formulating a theorem or 
giving conditions justifying this. A more frequently occurring problem is reversing 
the order of integration in a repeated integral. For example, even when 

rOO / rOO \ rOO / rOO \ 

J y j f (x, y) dx) dy and j Ij ^ f(x,y)dy\dx 

both exist, then still they do not necessarily have the same value (see exercise 6.6). 
Theorems on interchanging the order of integration will not be presented here. The 
interested reader can find such theorems in, for example, Fourier analysis by T.W. 
Korner, Chapters 47 & 48. When we interchange the order of integration in the 
proof of a theorem, we will always give sufficient conditions in the theorem such 
that the interchanging is allowed. 

After these preliminary remarks we now start examining the properties of the 
Fourier transform. 


6.4.1 Linearity 

Linear combinations of functions are carried over by the Fourier transform into the 
same linear combination of the Fourier transforms of these functions. We formulate 
this linearity property in a precise manner in the following theorem. 

Let f{t) and g(t ) be two functions with Fourier transforms F(cn) and G(a>) respec¬ 
tively. Then aF{w) + bG(cd) is the Fourier transform ofaf(t) + bg(t). 

Proof 

This theorem follows immediately from the linearity of integration: 

J (af\ (t) + b fiit)) dt = a J f\(t) dt + b J f 2 (t)dt 
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THEOREM 6.2 

Spectrum of the complex 
conjugate 


THEOREM 6.3 
Shift in the time domain 


Phase factor 


THEOREM 6.4 

Shift in the frequency domain 


for arbitrary functions /j and /> and a, b e C. Now take f\{t) = f(t)e la>t and 

MO = g(t)e- i(0t . m 

Because of this property, the Fourier transform is called a linear transformation. 


6.4.2 Conjugation 

For the complex conjugate of a function one has the following theorem. 

Let fit ) be a function with spectrum F(a>). Then the spectrum of the function fit) 
is given by F(—to). 

Proof 

This result follows immediately from the properties of definite integrals of complex¬ 
valued functions (see section 2.3): 

/ oo _ poo _ 

f(t)e-‘ mr dt = / f(t)e^t dt = F(-«»). 

-oo 2—00 

When in particular the function /(f) is real-valued, so /(f) = /(f), then theorem 
6.2 implies that F(—w) = F(a>), or F(—a>) — F(io). 


6.4.3 Shift in the time domain 

For a given function /(f) and a fixed a e R, the function /(f — a) is called the 
function shifted over a. There is simple relationship between the spectra of these 
two functions. 

Let f(t ) be a function with spectrum F(a>). Then one has for any fixed a el that 
(Tf(t-a))(m) = e- ima F(m). 

Proof 

By changing to the new variable r = f — a one obtains 

/ oo poo 

fit - a)e~ i0Jt dt = / fix)e- i0}(r+a) dr 

-OO 2—00 

= e~ i<va F{M). 

■ 

So when a function is shifted over a in the time domain, its spectrum is multiplied 
by the factor e~ uoa . Note that this only changes the phase spectrum and not the 
amplitude spectrum. The factor e~ uoa is called a phase factor. 


6.4.4 Shift in the frequency domain 

For a shift in the frequency domain there is a result similar to that of section 6.4.3. 

Let fit) be a function with spectrum F(a>). Then one has for a e R that 
CFe iat fit))im) = Fico-a). 

Proof 

/ OO POO 

f( t )e~ i((0 ~ a)t dt = / e iat fit)e~ i0)t dt = iTe iat fit))i(o). 
-oo J —OO __ 
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Modulation theorem 


EXAMPLE 


THEOREM 6.5 
Scaling in the time domain 


EXAMPLE 


Time reversal 


As an application of theorem 6.4 we mention the so-called modulation theorem : 
when Fico) is the spectrum of fit), then 

Fico —a) F(co + a ) 

{fF f(t) cos at) (to) = ---1-—--. (6.17) 

Since cos at — e lat /2 + e~ ,at /2, (6.17) follows from theorem 6.4 combined 
with the linearity from theorem 6.1: {F fit) cos at) ico) = ((Ff{t)e la, )(a>) + 
iFf(t)e~ iat )(co))/2 = Fico -a)/2 + F(co + a)/2. If f(t) is a real-valued sig¬ 
nal, then f(t) cos at describes a so-called amplitude modulated signal (this relates 
to AM on a radio: amplitude modulation). 


For f{t) = Pa(t) it follows from the results of section 6.3.1 that 


(fF. Pa (t) cos bt)(co) 


sin(a(a> — b)/2) 
a> — b 


+ 


sin(a(a> + b)/ 2) 
to + b 


◄ 


6.4.5 Scaling 

We now describe the effect of scaling, or dilation, in the time domain. 

Let f(t) be a function with spectrum Fico). Then one has for cel with c^O that 
{Ff(ct))(co) = \c\- x Ffc-'w). 

Proof 

We assume that c > 0 (give the proof yourself for the case c < 0). By substituting 
r = ct it follows that 

/ OO pOO 

fict)e~ iQJ ' dt = c~ l f(r)e~ ia,x l c dr 

-oo J —OO 

= c~ x F(c~ l co). 

■ 

Consider the block function p a (t) defined by (6.10), whose spectrum is given by 
(6.11). According to the scaling property one then has for c > 0 

1 2sin(aai/2c) 2 sin(aa>/2c) 

iFpa(ct))im) =- 7 -= -■ 

c co/c to 

This also follows at once from the fact that p a (ct) equals p a / c (t )• ^ 

A special case of scaling is the so-called time reversal, that is, replacing t by —t 
in the function fit). Applying theorem 6.5 with c = -lwe obtain that 

(fF f (—f))(&>) = Fi-co). (6.18) 


6.4.6 Even and odd functions 

A function / : M —>■ C is called even when /(— t) = fit) for all t e R and odd 
when f(—t) = — fit) for all t e R (also see section 3.4). The function cos t and the 
functions p a and q a from sections 6.3.1 and 6.3.2 are examples of even functions, 
while the function sin t is an odd function. If we replace the function q a it) in the 
first part of section 6.3.2 by an arbitrary even function fit), then we obtain 
poo 

Fico) = 2 I fit) cos cot dt. (6.19) 

Jo 
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Fourier cosine transform 


Fourier sine transform 


EXAMPLE 


THEOREM 6.6 

Selfduality 


One now calls the integral in the right-hand side (so without the factor 2) the Fourier 
cosine transform of the even function /(f); we denote it by F c (a>), so F(a >) = 
2F c (a>). Since cos (—cot) = cos cot, the function F( to) is in this case an even 
function as well. This also follows from (6.18) since F(—to) = {F /(—f))(a>) = 
(F f(t))(a>) = F(w). If, in addition, we know that /(f) is real-valued, then it fol¬ 
lows from (6.19) that F(to) is also real-valued. We already saw this in sections 6.3.1 
and 6.3.2 for the functions p a and q a . Hence, for an even and real-valued function 
/(f) we obtain that F(a>) is also even and real-valued. 

When a function /(f) is only defined for f > 0, then one can calculate the Fourier 
cosine transform of this function using the integral in (6.19). This is then in fact the 
ordinary Fourier transform (up to a factor 2) of the function that arises by extending 
/ to an even function on R; for f < 0 one thus defines / by /(f) = /(—f). The 
value at f = 0 is usually taken to be 0, but this is hardly relevant. 

There are similar results for odd functions. If g : R —> C is odd and if we use 
the fact that smart = (e la>t — e~ ,a>t )/2i, then we obtain, just as in the case of even 
functions. 


poo 

G(a>) = — 2i I g(t) smart dt. (6.20) 

Jo 

One then calls the integral in the right-hand side (so without the factor —2i) the 
Fourier sine transform of the odd function g(f); we denote it by G s (w), so G{ar) = 
—2 iG s (a>). Now G(ar) is an odd function. Again this also follows from (6.18). If, 
in addition, we know that g(t) is real-valued, then it follows from (6.20) that G(ar) 
can only assume purely imaginary values. 

If a function g(t) is only defined for f > 0, then one can calculate its Fourier sine 
transform using the integral in (6.20). This is then the ordinary Fourier transform 
(up to a factor —2i) of the function that arises by extending g to an odd function on 
R; for t < 0 one defines g by g(t) = —g(—t) and g(0) = 0. 

Consider for t > 0 the function /(f) = e~ at , where a > 0 is fixed. Extend this 
function to an even function on R. Then the Fourier transform of / equals the 
function 2 a/(a 2 + or). This is because the even extension of / is the function 
e~ a \ r I and the Fourier transform of this function has been determined in section 
6.3.3. Because of the factor 2, the Fourier cosine transform is given by a/(a 2 Far). 
In exercise 6.14 you will be asked to determine the Fourier transform of the odd 
extension of / (for the case a = 1). ^ 


6.4.7 Self duality 

The selfduality derived in this section is a preparation for the distribution theory 
in chapters 8 and 9. First we observe the following. Until now we have always 
regarded /(f) as a function of the time f and F(ar) as a function of the frequency 
or. In fact / and F are just two functions from R to C for which the name of the 
variable is irrelevant. 

Let f{t) and g(t) be piecewise smooth and absolutely integrable functions with 
spectra F{ar) and G(ar) respectively. Then 

/ oo poo 

f(x)G(x)dx = / F(x)g(x)dx. 

-oo J— oo 
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THEOREM 6.7 
Differentiation in time 
domain 


EXAMPLE 6.2 


Proof 

From the definition of spectrum it follows that 


£ 


f(x)G(x) dx = 


= f°° (T 8(y)e~ ixy dy\ 

d—oo \J—o o / 

-rs 

J—o o J—o o 


f{x)g{y)e lxy dydx. 


We mention without proof that under the conditions of theorem 6.6 one may inter¬ 
change the order of integration. We then indeed obtain 


£ 


f(x)G(x) dx = 


/ oo / £ c 

-oo ‘KL 


/(x)e ,J: - V dx 


)*-£ 


g(y)F(y)dy. 


6.4.8 Differentiation in the time domain 

Important for the application of Fourier analysis to, for example, differential equa¬ 
tions is the relation between differentiation and Fourier transform. In this section we 
will see how the spectrum of a derivative f' can be obtained from the spectrum of 
/. In particular it will be assumed that /(f) is continuously differentiable, so f' ft) 
exists on R and is continuous. 

Let f{t) be a continuously differentiable function with spectrum F(a>) and assume 
that linif-^ioo /(f) = 0. Then the spectrum of f ft) exists and {Tf'){co) = 
icoFia)). 

Proof 

Since f' is continuous it follows from integration by parts that 

r B 

lint / f'(t)e ' wt dt 
A—>— oo,B—>oo J a 



= lim f(B)e~ i<oB - lint f(A)e~ itoA + icoF(co). 
B— >oo A— >—oo 


where in the last step we used that F(a>) exists. Since lim^-too /(f) = 0, it follows 
that lim£_ j . 00 f(B)e~ iu>B = 0 and lim / i_ j ._ 00 f{A)e~ ialA = 0. Hence, (fF f')(oj) 
exists and we also see immediately that {fFf'){(d) = ia>F{a>). g 

Of course, theorem 6.7 can be applied repeatedly, provided that the conditions are 
satisfied in each case. If, for example, / is twice continuously differentiable (so f" 
is now a continuous function) and both linv-^q-oo /(f) = 0 and limf-^q-oo f'ft) = 
0, then theorem 6.7 can be applied twice and we obtain that (fFf"){a>) — 
(ia>)~F(ai) = —arF(a)). In general one has: if / is m times continuously dif¬ 
ferentiable and linif-j. ±oo /®(0 = 0 for each k — 0, 1, 2. m — 1 (where /® 

denotes the A:th derivative of / and / ^ = /), then 

(ff (m) ){w) = (i W ) m F(co). (6.21) 

We will use the Gauss function to illustrate theorem 6.7; it is the only continuously 
differentiable function among the examples in section 6.3. 

The derivative of the function /(f) = e~ at is given by the continuous function 

2 2 

f'ft) = —2 ate~ at . Moreover, lim^ioo e~ at = 0. Theorem 6.7 can thus be 
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THEOREM 6.8 

Differentiation in frequency 
domain 


EXAMPLE 6.3 


applied and from (6.16) we obtain 

CF(-2 ate~ at2 mco) = 

V a 

◄ 


6.4.9 Differentiation in the frequency domain 


In section 6.4.8 we have seen that differentiation in the time domain corresponds to 
multiplication in the frequency domain. The converse turns out to be true as well. 

Let f (t) be an absolutely integrable function with spectrum F(a>). If the function 
tf{t) is absolutely integrable, then the spectrum F(co) is differentiable and F'{a>) = 

-(ntf(t))(co). 


Proof 

In order to show that F{a>) is differentiable, we determine 


F(a> + /?) - F(a>) 

lint - = lim 

h^O h h 


/ oo 

-oc 


= lim 
h^Qj- 




— OO 

oo 


p —i(co+h)t _ p —ia>t 

m --- dt 

h 


f (t)e~ 


, e~ ih ' - 1 


dt. 


oo 


Again we mention without proof that the limit and the integral may be interchanged. 
Furthermore, one has 


e~ iht - 1 

lim - = lim 

/i->0 h h —>-0 


cos ht — 1 sin ht 

- i —:— 


= —it 


(apply for example De 1'HopitaTs rule) and so 


lim 

/i^O 


F(a> + h) — F(co) 
h 



{-itf{t))e~ iml dt. 


According to our assumption, the function tf{t) (and so —itf(t) as well) is abso¬ 
lutely integrable, which implies that the limit indeed exists. This shows that F(a>) 
is differentiable and we also immediately obtain that F'(a >) = —(J-itf(t))(co). g 


Again, this rule can be applied repeatedly, assuming that in each case the condi¬ 
tions are met. When, for example, f(t), tf(t) and t~ fit) are absolutely integrable, 
then F(a>) is twice differentiable and F"(a >) = CF(-it) 2 f(t))(a >). In general one 
has: if t k f(t) is absolutely integrable for k = 0, 1, 2,..., m. then F(a >) is m times 
differentiable and 

F (m \co) = in-it) m f(t )){co). (6.22) 


The function tp a (t ) satisfies the conditions of theorem 6.8 and hence 


1 


(Ftpa(m<o) = --F'ied) = i 


. / 2 sin(aa>/2)\ , 


flcos(aa>/2) 2sin(aai/2) 
= *-'- 2 -• 

Ft) ft 


◄ 
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THEOREM 6.9 
Integration in time domain 


THEOREM 6.10 

Continuity of spectra 


6.6 

6.7 

6.8 

6.9 


6.4.10 Integration 

Finally we will use the differentiation rule in the time domain to derive a rule for 
integration in the time domain. 

Let f{t ) be a continuous and absolutely integrable function with spectrum F(a>). 
Assume that lim^oo f !_ 00 fit) dr = 0. Then one has for that 

(t f f{T)dr\(co)= —. 

V J-o o / I® 

Proof 

Put g(t) = fit) dr. Since / is continuous, it follows that g is a continuously 
differentiable function. Moreover, g'(t) — fit) (fundamental theorem of calcu¬ 
lus). Since, according to our assumptions, lim(_ s .± 00 git) = 0, theorem 6.7 can 
now be applied to the function g. One then obtains that iTf)ia>) = iJ-g')ia>) = 
icoiiFg )(a>) and so the result follows by dividing by ia> for a/O. g 

Note that linif^-oo g(0 = fir) dr — 0. But f^f > 00 fit)dz is precisely 
F(0), and so the conditions of theorem 6.9 apparently imply that F(0) = 0. 


6.4.11 Continuity 

We want to mention one final result which is somewhat separate from the rest of 
section 6.4. It is in agreement with a fact that can easily be observed: all spectra 
from section 6.3 are continuous functions on R. 

Let fit) be an absolutely integrable function. Then the spectrum Fiat) is a contin¬ 
uous functions on R. 

Since theorem 6.10 will not be used in the future, we will not give a proof (see 
for example Fourier analysis by T.W. Korner, Lemma 46.3). For specific functions, 
like the functions from section 6.3, the theorem can usually be verified quite easily. 

The function sin t/t is not absolutely integrable (this was noted in section 6.3.1). 
In exercise 7.5 we will show that the spectrum of this function is the discontinuous 
function Ttpiico). 

EXERCISES 

In this exercise we will show that interchanging the order of integration is not al¬ 
ways allowed. To do so, we consider the function fix, y ) on {(*, y) e R 2 | x > 0 
and y > 0} given by fix, y) — {x— y)/(.T+y) 3 . Show that f^°if^° fix, y) dx) dy 
and /^(/j 00 fix, y) dy) dx both exist, but are unequal. 

Use the linearity property to determine the spectrum of the function /(f) = 
3e““ ’ I + liqait), where q a it) is the triangle function from (6.12). 

Use the modulation theorem to determine the spectrum of the function /(f) = 
e -7 l 1 1 cos nt. 

a Let Fiat) be the spectrum of /(f). What then is the spectrum of /(f) sinaf 
(a e R)? 

b Determine the spectrum of 


fit) = 


sin f for — n < t < n, 
0 otherwise. 
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6.10 

6.11 

6.12 

6.13 

6.14 

6.15 

6.16 

6.17 

6.18 

6.19 


Let be R and a e C with Rea > 0 be fixed. Determine the Fourier transform of 
the function f(t ) = e(t)e~ at cos bt and g(t) = e(t)e~ at sinfof. 

Prove the scaling property from theorem 6.5 for c < 0. 

Verify that for an odd function f(t) one has F(co) — —2i f{t) sin tot dt. 

a Let /(f) be a real-valued function and assume that the spectrum F(co) is an even 
function. Show that F(cu) has to be real-valued, 
b Let /(f) be a real-valued function. Show that | F(u>) | is even. 

For t > 0 we define the function /(f) by /(f) = e~ l . This function is extended 
to an odd function on R, so /(f) = — e 1 for f < 0 and /(0) = 0. Determine the 
spectrum of /. 

Consider for a > 0 fixed the function 


f(0 = 


1 for 0 < f < a, 
0 for t > a. 


a Determine the Fourier cosine transform of /. 
b Determine the Fourier sine transform of /. 

Determine in a direct way, that is, using the definition of F(u>), the spectrum of the 
function tp a (t), where p a (t) is given by (6.10). Use this to check the result from 
example 6.3 in section 6.4.9. 

2 

Consider the Gauss function /(f) = e~ at . 

a Use the differentiation rule in the frequency domain to determine the spectrum 
of f/(f). 

b Note that f/(f) = — f'(t)/2a. Show that the result in part a agrees with the 
result from example 6.2, which used the differentiation rule in the time domain. 

Give at least three functions / whose Fourier transform F(to) is equal to kf{co), 
where k is a constant. 


Determine the spectrum of the function e(t)te at (for a e C with Re a >0). 


6.5 Rapidly decreasing functions 

In this section the results on differentiation in the time domain from section 6.4.8 
are applied in preparation for chapters 8 and 9 on distributions. To this end we will 
introduce a collection of functions V which is invariant under the Fourier transform, 
that is to say: if /(f) e V , then F(a >) e V. We recall that, for example, for the 
absolutely integrable functions this is not necessarily the case: if /(f) is absolutely 
integrable, then F(a>) is not necessarily absolutely integrable. If we now look at the 
differentiation rules from sections 6.4.8 and 6.4.9. then we see that differentiation 
in one domain corresponds to multiplication in the other domain. We thus reach the 
conclusion that we should introduce the collection of so-called rapidly decreasing 
functions. It will turn out that this collection is indeed invariant under the Fourier 
transform. Let us write /(f) e C°°(R) to indicate that / can be differentiated 
arbitrarily many times, that is, /®(f) exists for each k e N. It is also said that / is 
infinitely differentiable. 

DEFINITION 6.3 A function f : R —> C in C°°(R) is called rapidly decreasing if for each m and 

Rapidly decreasing function n e N the function t n f^ m \t) is bounded on R, that is to say. there exists a constant 

M > 0 such that |f"/( m )(f)| < M for all t e R. 
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THEOREM6.il 


THEOREM 6.12 

S is invariant under Fourier 

transform 


In this definition the constant M will of course depend on the value of m and n. 
The term ‘rapidly decreasing' has a simple explanation: for large values of n e N 
the functions 1 1 1“" decrease rapidly for t -*■ ±oo and from definition 6.3 it follows 
for m = 0 that | fit) | < M \ t \~ n for each n e N. Hence, the function / (and even 
all of its derivatives) has to decrease quite rapidly for t —> ±oo. 

The collection of all rapidly decreasing functions will be denoted by <S(R) or 
simply by S. For f € S it follows immediately from the definition that cf € S as 
well for an arbitrary constant c e C. And since 

| t n (f + g) (m \t) | = | t n f (m \t) + t n g (m \t) | < | t n f (m \t) | + | t n g (m \t) | , 

it also follows that / + g e S whenever / e S and g e S. 

Now this is all quite nice, but are there actually any functions at all that belong to 
5, besides the function f(t) = 0 (for all t e R)? 

2 

The Gauss function fit) = e~ at (a > 0) belongs to S. 

Proof 

First note that / is infinitely differentiable because fit) = {ho g)(t), where g(t) = 
— at 2 and h(s) = e s are infinitely differentiable functions. From the chain rule it 
then follows that / e C°°(R). By repeatedly applying the product rule and the 
chain rule again, it follows that ( e~ at )^ m * is a finite sum of terms of the form 
ctkg-cn e jq an( j c a constant). Hence, t n (e~ ar )*■'") is also a finite sum of 
terms of the form ct k e~ at for each m and n e N, and we must show that this is 
bounded on R. It now suffices to show that t k e~ at is bounded on R for arbitrary 
leN, since then any finite sum of such terms is bounded on R. The boundedness 
of t k e~ ar on R follows immediately from the fact that t k e~ ar is a continuous 
function with linif-^ioo t k e~ ar =0. g 

By multiplication and differentiation one can obtain new functions in S', for 
fit) e S one has t n fit) e S for each n G N and even (r"/(t)) <m ^ e S for 
each m and n e N. For the proof of the latter statement one has to apply the product 
rule repeatedly again, resulting in a sum of terms of the form t k f^-(t), which all 
belong to S again because / e S. The same argument shows that the product / • g 
also belongs to S when /, g e S. 

If fit) e S. then Fiat) e S. 

Proof 

First we have to show that Fim) e C°°iR). But since / e S, it follows that 
t p fit) € S for each p e N and so, according to the remark above, tPfit) e S 
is absolutely integrable for each p e N. The differentiation rule in the frequency 
domain can now be applied arbitrarily often. Hence, F{d) e C°°iR) and (6.22) 
holds. We still have to show that d n F^id) is bounded on R for every m, n e N. 
According to (6.22) one has 

w n F (m \d ) = d n {Ti-it) m f{t)){d). (6.23) 

We now want to apply the differentiation rule in the time domain repeatedly. In 
order to do so, we first note that t m f if) e S, which implies that this function is 
at least n times continuously differentiable. Also (t m /(r))® e S for each k — 
0, 1,..., n — 1 and so we certainly have lim, ^±oo(f" ! /(0) W — 0- Hence, the 
differentiation rule in the time domain can indeed be applied repeatedly, and from 
(6.21) it then follows that 

iid) n {Tgit)){d) = {Tigit^Xco), (6.24) 
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Convolution 


where git) — (—it) m f(t). Combining equations (6.23) and (6.24) shows that 
(/&>)” F^ m Ua>) is the Fourier transform of ( g(t ))^ — ((— it) m f(t))^"\ which is 
absolutely integrable. The boundedness of (icy)” F^ m \u>), and so of cu” F (m) (w), 
then follows from the simple relationship (6.7), applied to the function (g(t))^ n f 
This proves that F(a >) e S. g 

2 

Let us take the Gauss function fit) = e~ at e S (a > 0) as an example. From 
(6.16) it indeed follows that F(u >) e S. This is because F(co) has the same form as 
fit). 


EXERCISES 

6.20 Indicate why e~ a I ’ I (a > 0) and (1 + t 2 )~ 1 do not belong to S. 

2 

6.21 Consider the Gauss function f(t) = e~ al (a > 0). 

a Verify that for arbitrary leN one has hm t ^± oc t k e~ at = 0. 
b Determine the first three derivatives of / and verify that these are a finite 
sum of terms of the form ct 1 f(t) (/ € N and c a constant). Conclude that 
lim i^±oof {k) (t) = 0 for k = 1, 2, 3. 

6.22 Let / and g belong to S. Show that f ■ g e S. 


6.6 Convolution 

Convolution of periodic functions has been treated in chapter 4. In this section we 
study the concept of convolution for non-periodic functions. Convolution arises, for 
example, in the following situation. Let fit) be a function with spectrum F{a>). 
Then F{co) is a function in the frequency domain. Often, such a function is multi¬ 
plied by another function in the frequency domain. One should think for instance of 
a (sound) signal with a spectrum F(a>) containing undesirable high or low frequen¬ 
cies, which we then send through a filter in order to remove these frequencies. We 
may remove, for example, all frequencies above a fixed frequency coq by multiply¬ 
ing F(u>) by the block function P2mni (0 )- g enera l one will thus obtain a product 
function F((d)G{co) in the frequency domain. Now the question is, how this alters 
our original signal fit). In other words: which function has as its spectrum the 
function /'’(cu)G(cu)? Is this simply the product function fit)g(t), where git) is a 
function with spectrum G(a>)? A very simple example shows that this cannot be the 
case. The product of the block function p a it) (now in the time domain) with itself, 
that is, the function ip a it)), is just p a it) again. However, the product of (T Pa)((n) 
(see (6.11)) with itself is 4 sin“(aai/2)/(u 2 , and this does not equal CFp a )ia>). We 
do recognize, however, the Fourier transform of the triangle function q a )t), up to 
a factor a (see (6.13)). Which operation can turn two block functions into a trian¬ 
gle function? The solution of this problem, in the general case as well, is given by 
convolution. 

The convolution product (or convolution for short) of two functions f and g. denoted 
by f * g, is defined by 

/ oo 

fit)git-x)dx forteK, 

-oo 

provided the integral exists. 

Before we discuss the existence of the convolution, we will first of all verify that 
(Pa * Pa)it) indeed results in the triangle function q a it), up to the factor a. 
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EXAMPLE 


One has 

/ oo 

Pa(.T)Pa{t - T )dz, 
-oo 


and this integral equals 0 if r < —a/2, r > a/2, t — r < —a/2 or t — x > a/ 2, so 
if t < —a/2, x < t — a/2, x > a/2 or r > t + a/2. 

For t > a or t < —a these conditions are fulfilled for each r e R and so (p a * 
p a )it) = 0 in this case. In the boundary cases t = a or t = —a the conditions 
are fulfilled for each r e R, except for one point (when, for example, t = a then 
we have the condition x > a/ 2 as well as r < a/2 and only x = a/2 does not 
satisfy this). Since one point will never contribute to an integral, we again have 
(Pa * Pa){t) = 0. 

Now if 0 < t < a, then 

(Pa * Pa)(t ) = f dr = a — t = a(\ — t — \ , 

Jt-a/2 \ a ) 

and if —a < t < 0, then 

rt+a / 2 / t \ 

( p a * Pa)(t ) = / dx=a + t= a\ \-\— I. 

J—a/2 V a) 

We thus have indeed ( p a * p a )(t) = aq a {t). In figure 6.9 we show once more, 
for various ‘typical’ values of t, the intervals such that the functions p a (x) and 
Pa{t — x) are non-zero. One only has a contribution to the integral {p a * Pa)(t) when 
the uppermost interval has an overlap with the other intervals sketched 
below it. ^ 


p a (x) 


P a ( t-x) 


2 2 

1-t-1-f-1 

0 




0 




0 jt-| 

+ + a 

f f+j 

- t ~i f 

t+ 2 

0 




0 t-l | t 

—1-1—a-!- 

t+ 2 


f > a 

f < -a 


0 < f < a 


-a < f < 0 


FIGURE 6.9 

Integration intervals in the calculation of ( p a * p a )(t) for typical values of t. 


If we now return to the general situation, then the convolution of two functions / 
and g will certainly exist if one of these functions, say /, is absolutely integrable, 
while the other function is bounded on R. For in this case one has 


i (/ * §m i = 


I L 


/(x)g(f - x)dx 


— OO 
OO 


r 


I /(x)g(f -x)\dr 


< M 


s 

J — ( 


I f(r)\dx, 
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THEOREM 6.13 
Convolution theorem 


where M is chosen such that | g(t ) | < M on R. Since / is absolutely integrable, 
it then follows that | (/ * g)(t) | < oo, in other words, f * g exists for each (el. 
Moreover, we see that / * g is bounded on R. Note that the preceding conditions are 
certainly satisfied when / and g belong to S. Another condition which guarantees 
the existence of / * g is that / and g should be absolutely integrable and that, in 
addition, | f(t) | 2 dt < oo and | g{t) | 2 dt < oo. We will not prove this. 
Functions satisfying this condition form an important class of functions; we will 
return to this in chapter 7. 

A simple property of convolution is commutativity, so f*g = g*f. This is 
because changing to the variable u = t — r gives 

/ oo roo 

f(z)g(t t) dx = / f(t - u)g(u ) du = (g* f)(t). (6.25) 

-oo J —oo 

We will now prove the important result that the spectrum of (/ * g)(t) is the product 
F(cl>)G(o>). This result is called the convolution theorem. 

Let f(t) and g(t) be piecewise continuous functions which, in addition, are abso¬ 
lutely integrable and bounded. Let F(a>) and G(a>) be the spectra of f and g. Then 
f * g is absolutely integrable and 


T(f * g)(w) = F(w)G(w). 


(6.26) 


Proof 

We have just seen that f * g exists and is bounded on R, since g is bounded and / 
is absolutely integrable. Next we note that 

/ oo / roo \ /-oo / roo \ 

(/ \ f (t)g(t — t)\dt\ dz = / |/(t)|( / | g(t - t) \dt I dr 

-oo \J —oo / J—oo \J—o o / 


—oo 
oo 


r \f(T)\dz [ 
J—oo J— 


| /(t) | dr I | g(u) | du < oo, 


since / and g are absolutely integrable. Under the conditions of the theorem one 
may interchange the order of integration. We then obtain 


£ 


I if * g)(t) I dt < 


nr 


I f(z)g(t z) | dx J dt < 00, 


in other words, f * g is absolutely integrable. In particular, T(f * g)(co) exists and 
from the definitions we see that 


-l 


T(f*g)(a» = / if * g)(t)e-' mt dt 


/ OO / POO \ 

30 (loo f(T)e ~ i0JTg{t - *)‘~ ia(f ~ T) dT) dt. 

Again one may interchange the order of integration and therefore 

/ oo . / roo . \ 

/( r)e~ ,0>z l g(t - r )e~ lm{t ~ T) dt ) rfr. 

-oo \J—oo / 
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Cross-correlation 

Autocorrelation 


6.23 

6.24 


6.25 


6.26 


If we now put u = t — x , then the inner integral equals g(u)e uou du = G(a>), 
and so we finally obtain 


T{f * g)(co) = G(co) 



f(x)e~ i(ot dx = G(to)F(<o). 


An example of this theorem has already been mentioned: for the spectrum of 
(p a * Pa)(t) = aq a (t ) one indeed has CFp a ) 2 ((o) = aCFq a )(oj). 

Closely related to convolution are the concepts cross-correlation and autocorre¬ 
lation. The cross-correlation p f g of two functions / and g is defined by p f g (f) = 
(, g * /)(f), where / is the function f(t) = /(— t). Taking g = / here one obtains 
the so-called autocorrelation p ff(t) = (/ * /)(f) of the function /. 


EXERCISES 

Calculate the convolution (e * e)(f), where e(t ) is the unit step function from exam¬ 
ple 6.1. Is (e * e)(f) absolutely integrable? 

The functions /(f) and g(t) are defined by 

, _ [ t _1 / 2 for 0 < t < 1 , . . _ | (1 — f) -1 / 2 for 0 < t < 1, 

' ? (0 elsewhere, ^ f j 0 elsewhere. 

a Show that / and g are both absolutely integrable. 

b Show that (f*g)( 1) = /J r _1 dr and hence that the convolution does not exist 
for t = 1. So in general the absolute integrability of / and g is not sufficient for the 
existence of the convolution product. 

Let / and g be two functions with f(t) = git) — 0 for t < 0. Functions with this 
property are called ‘causal functions’ (see section 1.2.4). The unit step function e(t) 
is an example of a causal function. Show that (/ * g)(t) — 0 for t < 0 (so f * g is 
again causal) and that for t > 0 one has 

( f*g)(t)=f fiz)g{t-x)dz. 

Jo 


a Show that ( e~ v I * e~^ v l)(f) = (1 + | f [)e~^' I. 
b Use theorem 6.13 to determine the spectrum of (1 + [ t \)e~ 1 1 L 
c Determine in a direct way the spectrum of (1 + 1 1 \)e ~^ 1 1 (use the properties of 
the Fourier transform). 


SUMMARY 


The Fourier transform or spectrum F(a>) of a function /(f) : M 


F(co) = 



fit)e~ iMt dt 


for ®el, 


C is defined by 


provided the integral exists as improper Riemann integral. This integral certainly 
exists as improper Riemann integral when /(f) is absolutely integrable. In that 
case, F{a>) is actually a continuous function on R. The mapping /(f) —> Fico) is 
the Fourier transform T. 

For a number of frequently used functions (the block function p fl (f ), the triangle 
function q a (t ), the function e~ a \ 1 1, and the Gauss function e~ at ) we determined 
the spectrum; these have been included in table 3. 
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6.27 


6.28 


6.29 


Trapezi um function 


Subsequently, we derived a number of properties. In succession we treated lin¬ 
earity, conjugation, shift in the time domain and the frequency domain, scaling, even 
and odd functions, selfduality, differentiation in the time and in the frequency do¬ 
main, and integration in the time domain. These properties can be found in table 4. 

As an application of the differentiation rule it was shown that the set S of rapidly 
decreasing functions is invariant under the Fourier transform: if /(f) e 5, then 
F(w) e S. 

The convolution product f * g is given by 


(/ * g)(0 



/(f)g(f - r )dr. 


provided the integral exists. One has / * g = g * /. If / and g are absolutely 
integrable, piecewise continuous, and bounded, then the convolution theorem holds: 
T(f * g)(a>) = FWGM. 


SELFTEST 

Consider the function g(f) = e(t)e~ 2 '. 

a Sketch the graph of g(f) and determine the spectrum G(a>). Also give the real 
and imaginary part of G(a>). 
b Determine the spectrum of (g * g)(f). 

c Show that (g * g)(f) = e(t)te~ 2 ' by calculating the convolution and subse¬ 
quently determine the spectrum of e{t)te~ 21 . 

d Give the relationship between the spectrum of the function e{t)te~ 2 ' and G(co ) 
in terms of differentiation. Obtain in this way the spectrum of e(t)te~~' again and 
compare the result with part b. 

Consider the Gauss function g(f) = e~‘ / 2 with Fourier transform G(&>) = 
sfljte - ^ / 2 . Now determine the Fourier transform of the following functions: 
a /l(0 = /loo Tg(r) dr, 

b / 2 (0 = t 2 g{t), 

c / 3 (f) = (f 2 -It + l)e- ?2 / 2+r_1 / 2 , 

d / 4 (f) = sin4f fLoo Tg(t) dr, 

e h(t) = e-* , \ 

Define the function T ( t) by 

I I for 1 1 1 < 1 , 

2 - 1 1 1 for 1 < 1 1 1 < 2 , 

0 for 1 1 1 > 2 . 

a Sketch the graph of the function T (f); it is called the trapezium function. 
b Show that T(t) — (p\ * pf)(t ), where p a is the block function on the interval 
{—a/2, a/2). (Hint: from the definition of T{t) we see that we have to distinguish 
between the cases t > 2 , t < — 2 , 1 < t < 2 , —2 < t < — 1 and — 1 < t < 1 .) 
c Determine the spectrum of T (t). 
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CHAPTER 7 


The fundamental theorem of the 
Fourier integral 


INTRODUCTION 


Now that we have calculated a number of frequently used Fourier transforms and 
have been introduced to some of the properties of Fourier transforms, it is time to 
return to the Fourier integral 

— / F(co)e l0)t da). 

2tt 7—oo 

It is quite reasonable to expect that, analogous to the Fourier series, the Fourier in¬ 
tegral will in general be equal to /(f). In section 6.1 this has already been derived 
intuitively from the fundamental theorem of Fourier series. Therefore, we start this 
chapter with a proof of this crucial result, which we will call the fundamental the¬ 
orem of the Fourier integral. It shows that the function /(f) can be recovered from 
its spectrum F(a>) through the Fourier integral. We should note, however, that the 
integral should not be interpreted as an ordinary improper Riemann integral, but as 
a so-called ‘Cauchy principal value’. 

Using the fundamental theorem we subsequently prove a number of additional 
properties of the Fourier transform. One of the most famous is undoubtedly Parse- 
val’s identity 

/ OO j poo 

\f(t)\ 2 dt = — / \F(cv)\ 2 dco, 

-OO ^ 7 — 00 

which has an important interpretation in signal theory: if a signal has a ‘finite 
energy-content' (meaning that | /(f) | 2 dt < oo), then the spectrum of the 
signal also has a finite energy-content. 

The fundamental theorem from section 7.1, together with its consequences from 
section 7.2, conclude the Fourier analysis of non-periodic functions. The final sec¬ 
tion then treats Poisson’s summation formula. Although not really a consequence 
of the fundamental theorem, it forms an appropriate closing subject of this chapter, 
since this formula gives an elegant relationship between the Fourier series and the 
Fourier integral. Moreover, we will use Poisson’s summation formula in chapter 9 
to determine the Fourier transform of the so-called comb distribution. 
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LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know the Riemann-Lebesgue lemma and know its interpretation for non-periodic 
functions 

- know the concept of Cauchy principal value 

- know and can apply the fundamental theorem of the Fourier integral 

- know the uniqueness theorem for the Fourier transform 

- know and can apply the reciprocity property 

- know and can apply the convolution theorem in the frequency domain 

- know and can apply Parseval’s identities 

- know the concepts of energy-content and of energy-signal 

- can calculate definite integrals using the fundamental theorem and Parseval’s iden¬ 
tities 

- know and can apply Poisson’s summation formula*. 


7.1 The fundamental theorem 


THEOREM 7.1 

Riemann-Lebesgue lemma 


In this section we give a precise meaning to the Fourier integral in (6.8). We will 
prove that, under certain conditions on the function / in the time domain, the Fourier 
integral converges and. just as in the case of Fourier series, will produce the original 
function /. Hence, through the Fourier integral the function f(t) can be recovered 
front its Fourier transform F(co). The result is crucial for the remainder of the 
Fourier theory and so we will present a proof of this result in this book. Before we 
can give this proof, some preparatory results will be derived, although these are also 
of interest in themselves. A first step is the so-called Riemann-Lebesgue lemma 
on R. For the concepts absolutely integrable and piecewise continuous we refer to 
definitions 6.2 and 2.3 respectively. 


Let f(t) be an absolutely integrable and piecewise continuous function on R. Then 
lim F(a> ) = lim 

a>—> ±oo u >—>±oo 

Proof 

Let e > 0. Since / is absolutely integrable, there exist A, B e R such that 

po o p A 

/ |/(f)l*+/ \ f(t)\dt < e/2. 

J B J—oo 

On the remaining bounded interval [A. B ] we use the Riemann-Lebesgue lemma 
from section 4.1 (theorem 4.2): there exists a G > 0 such that for | a> \ > G one has 


£ 


f(t)e- 


"dt = 0. 


(7.1) 



f(t)e~ ia>t dt 


< e/2. 


By applying the triangle inequality repeatedly, it follows that 


£ 


f(t)e~ ,m ' dt 


< 

p A 

/ f{t)e~ uot dt 

POO 

+ / f{t)e~ i(ot dt 

+ 

P B 

/ / (t)e~ uor dt 


J—oo 

Jb 


Ja 


p A 

poo 

pB 

/ 1/(0 \dt + 

/ 1/(0 \dt + 

/ / (t)e~ lmt dt 

J—oo 

Jb 

Ja 


< e/2 + e/2 = e 
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DEFINITION 7.1 

Cauchy principal value 


EXAMPLE 


for | at | > G, where in the second step we used that | f git) dt | < J \ git) \ dt and 
| e ~ imt | = 1. This proves theorem 7.1. ^ 

Since e~ la>t = cos a>t — i sin cot, it follows immediately that (7.1) is equivalent to 

/ OO /*00 

fit) sin cot dt = 0 and lim / fit) coscot dt = 0. (7.2) 

-OO (0^>±00j_ 00 


As a matter of fact, the Riemann-Lebesgue lemma is also valid if we only assume 
that the function / is absolutely integrable on R. This more general theorem will not 
be proven here, since we will only need this result for absolutely integrable functions 
that are piecewise continuous as well; for these functions the proof is easier. 

Theorem 7.1 has a nice intuitive interpretation: when we integrate the function / 
against ever higher frequencies, so for increasing to, then everything will eventually 
cancel out. This is because the function / will change little relative to the strong 
oscillations of the sine and cosine functions; the area of juxtapositioned oscillations 
of fit) sin cot, for example, will cancel each other better and better for increasing to. 

Besides theorem 7.1 we will use the following identity in the proof of the funda¬ 
mental theorem: 



This identity has been proven in section 4.4.1. Using theorem 7.1 and formula (7.3) 
we can now prove the fundamental theorem. It will turn out, however, that the 
Fourier integral will not necessarily exist as an improper Riemann integral. Hence, 
to be able to formulate the fundamental theorem properly, we need the concept of a 
Cauchy principal value of an integral. 

The value ofXtmA^oo f^ A fit) dt is called the Cauchy principal value of the inte¬ 
gral S-oo /(0 dt, provided that this limit exists. 

The difference between the Cauchy principal value and the improper Riemann 
integral is the fact that here the limits tend to oo and —oo at the same rate. We 
recall that in the improper (Riemann) integral we are dealing with two independent 
limits B —> oo and A —> — oo (also see the end of section 6.1). When a function 
has an improper integral, then the Cauchy principal value will certainly exist and it 
will have the same value as the improper integral (just take ‘A = B'). The converse 
need not be true, as the next example shows. 

The improper integral t dt does not exist, but the Cauchy principal value is 0 
since fh A t dt = 0 for each A > 0 and hence also for A —> oo. ^ 


Since the Cauchy principal value of the Fourier integral is equal to 


lim — 


hi: 


Fico)e Uot dev, 


A—*oo 2 jc J—a 

it seems plausible to investigate for arbitrary A > 0 the integral 


2- f Flco)e i(0t dcv= — 
2 Tt J-A 


-has: 


fis)e 


ds e IMt dev 


(7.4) 


more thoroughly. If we may interchange the order of integration (we will return to 
this in the proof of the fundamental theorem), then it would follow that 

— f Ficv)e Uot dcv= — [ fis)( f e i(o{t ~ s) da\ ds. 

2?r J-a 2n J - 0 0 \J- A ) 



7.1 The fundamental theorem 


167 


The inner integral can be calculated (as a matter of fact, it is precisely the Fourier 
transform of the block function pja at s — t; see section 6.3.1) and it then follows 
that 



By changing to the variable r = t — s we finally obtain the important formula 



This result is important because it shows us why the Fourier integral will converge 
to the value /(f) for A —> oo (assuming for the moment that / is continuous at f). 
To that end we take a closer look at the function Da( r) = sin At/t (for A > 0). 
The value at r = 0 is A, while the zeros of Da(t) are given by r = kn / A with 
k € Z (k 7^ 0). For increasing A the zeros are thus getting closer and closer to each 
other, which means that the function D ,has ever increasing oscillations outside 
r = 0. This is shown in figure 7.1. This makes it plausible that at a point t where 
the function / is continuous we will have 



(7.6) 


under suitable conditions on /. The reason is that for large values of A the strong 
oscillations of Da (t) outside r = 0 will cancel everything out (compare this with 
the interpretation of the Riemann-Lebesgue lemma), and so only the value of / at 


4 



FIGURE 7.1 

The function Da (t) for a large value of A. 
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THEOREM 7.2 


Step 1 


Step 2 


the point r = 0 will contribute to the integral (of course, this is not a proof of (7.6)). 
The constant n~ 1 in the left-hand side of (7.6) can easily be ‘explained’ since (7.3) 
implies that sin At/t dr = n for every A > 0 and hence also for A —> oo; 
but this is precisely (7.6) if we take for / the constant function 1. 

It now becomes clear how we shall proceed with the proof of the fundamental 
theorem. First we need to prove (7.6); combining this with (7.5) then immediately 
gives the fundamental theorem of the Fourier integral. As a matter of fact, the 
assumption that / should be continuous at t was only for our convenience: in the 
following theorem we will drop this assumption and so we get a slightly different 
version of (7.6). 

Let fit) be an absolutely integrable and piecewise smooth function on R. Then one 
has for each (el that 

1 sin At 1 

hm - fit t) - dr = - (/(f+) + fit-)). 

A —^ oo 7V J —oo T 2 


Proof 

In order to get a well-organized proof, we divide it into two steps. 

By splitting the integral in the left-hand side at r = 0, and changing from r to 
— r in the resulting integral over (—oo, oo), we obtain 


1 

lim — 

A—>oo Tt 



fit ~ r) 


sin At 
t 


dr 


1 

= lim — 

A—>oo Tt 



t ) + fit + T)) 


sin At 
- dr. 

T 


(7.7) 


Now note that by replacing At by i', and so t by v/A, and applying (7.3), it follows 
that 


lim f 

4—>oo Jo 


sin At 


dr = lim 
A—>oo 


r A si 

Jo 


smv jt 

dv = —. 
v 2 


If we multiply this equality by (/(/+) + fit—)) /tt we obtain 


o (/(*+) + fit-)) = Hm - 
2 A—>-oo 71 J o 


1 sinAT 

n Jo t 


ifit+) + fit-)) dr 


(7.8) 


(in fact, /(f+) + fit—) does not depend on t). If we now look at the result to be 
proven, it is quite natural to study the difference 


ir 

Tt JO 


sin At 

if it ~ r) + fit + t))- dr - 

T TT 


if 

Tt JO 


sin At 

(/(*+) + /(*-))- dT 


of the right-hand sides of (7.7) and (7.8) for A -*■ oo. If we can show that this 
difference tends to 0 for A oo, then the theorem is proven. We will do this in 
step 2. 

If we split the first integral in this difference at t = 1, then we see that the 
difference can be rewritten as I\ + Ij with 


h = - 

Tt 


h = — 

Tt 


if 

Tt JO 
1 

Tt Jl 


fit ~ T) - fit-) + fit + T) - ff+) 


fit - t) + fit + T) . 

-sin Ax ax. 


sin Ax dx, 
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We will now show that both /1 and I 2 tend to 0 as A —>■ 00 . To tackle I\ we define 
the auxiliary function g(r) by 


[ fit — t) — f it—) + f (t + t) — f (t+) 

<?( T ) = \ T 

1 0 

and thus 
1 

I\ — — I g(r) sin Ar dr. 

TC J —00 


for 0 < r < 1, 
otherwise. 


Note that outside the point r = 0, the function g(r) is certainly piecewise contin¬ 
uous. Since we assumed that / is piecewise smooth, theorem 2.4 implies that the 
limits lim T ^o(/0 + f) - /(?+))/r and lim r | 0 (/(f - r) - fit-))/ r, occurring 
in g(r), both exist and are equal to f'it+) and —f' it—) respectively. The function 
g is thus piecewise continuous at t = 0, and so on R. Moreover, g is certainly ab¬ 
solutely integrable and so it follows from the Riemann-Lebesgue lemma (theorem 
7.1) that lim^-^oo I\ = 0. We now apply a similar reasoning to h. To that end we 
define the auxiliary function h(r) by 


hi t) = 


fit ~ f) + fit + r) 

T 

0 


for r > 1, 
otherwise. 


and so 


1 f°° 

h = — / h(r) sin At dr. 

tt J—oo 


The function h is certainly piecewise continuous on R and also absolutely integrable 
since 1/r < 1 if r > 1 and the function / is absolutely integrable. We can therefore 
apply the Riemann-Lebesgue lemma again to obtain that lim^^oo I 2 — 0. This 
proves theorem 7.2. g 


If, in particular, the function / in theorem 7.2 is continuous at a point t, then we 
obtain (7.6). By combining theorem 7.2 with (7.5) we now immediately obtain the 
fundamental theorem. 


THEOREM 7.3 
Fundamental theorem of the 
Fourier integral 


Let f{t) be an absolutely integrable and piecewise smooth function on R and let 
F(a>) be the Fourier transform of f. Then the Fourier integral converges for each 
teRflja Cauchy principal value and 


f F(a))e l ‘ 
2 tr J-00 


00 1 

iatt * 1 


dco=- if(t+) + fit-)) . 


(7.9) 


Here fit+) = lim/^ 0 fit + h) and fit-) = lim/^q fit + h). 

Proof 

Without proof we mention that under the conditions of theorem 7.3 interchanging 
the order of integration, which was used to derive (7.5) from (7.4), is indeed allowed. 
From (7.5) it then follows that 

lint — / Fico)e la>t da> = lim — / fit — t)- dr. 

A —^OO 27T J —^ A—^OO Tt J — 00 T 

If we now apply theorem 7.2 to the right-hand side, then we obtain 
lim ±- f A Fico)e imt dco= l - (/(/+) + fit-)) , 

A —>00 2.71 J—A 2* 
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EXAMPLE 7.1 


EXAMPLE 7.2 


Inversion formula 

Inverse Fourier transform 


EXAMPLE 7.3 


proving theorem 7.3: the Fourier integral converges as a Cauchy principal value to 

(/(*+) + /(*-))/2. ■ 


The Fourier integral should in the first instance always be considered as a Cauchy 
principal value. Flowever, in many cases it is immediately clear that the integral 
also exists as an improper Riemann integral, for example when Fim) is absolutely 
integrable. Nevertheless, one should not jump to conclusions too easily, and as a 
warning we present a simple example showing that the Fourier integral can certainly 
not always be considered as an improper integral. 

Let f(t) be the function defined by /(f) = e(t)e~', where e (f) is the unit step 
function (see example 6.1). This function satisfies all the conditions of theorem 7.3 
and F(a>) = 1/(1 +im) (see table 3). For t = 0 it then follows from the fundamental 
theorem that 

fOO 1 

/ - ; — dco = n, 

J —OC 1 + 


since (/(/+) + fit —))/2 =1/2 for t = 0. This integral must be considered as 
a Cauchy principal value since it does not exist as an improper Riemann integral. 
This is because the imaginary part of 1/(1 + ia>) is —m/i 1 + m 2 ) and 


[ B —% dm = l - (ln(l + B 2 ) - ln(l + A 2 )) , 

J A 1 "b ^ ' ' 

which means that the limit does not exist for A —> — oo (or B —> oo). 


For a continuous function /(f), the right-hand side of (7.9) equals /(f) since in 
this case /(f+) = fit—) for each f e R. Let us give another example. 

Take /(f) = e~ a ^ r K then Fiat) = 2a/ia 2 + at 2 ) (see table 3). The function / 
satisfies all the conditions of the fundamental theorem and it is also continuous (and 
even). For each r e R we thus have 


„~a\t | 


2n J- 


2a 


j — oo cP + oP 


dm. 


(7.10) 


Since Fim) is even, this can also be written as a Fourier cosine transform (see sec¬ 
tion 6.4.6): 


„-a\ 


t\ = l [ 
x Jo 


0 a 2 + m 2 


cos mt dm. 


◄ 


Formula (7.9) is called the inversion formula for the Fourier transform on R. The 
name ‘inversion formula’ is clear: if the conditions of theorem 7.3 are met, then one 
can recover the original function /(f) from its spectrum Fim) using (7.9). There¬ 
fore. the function /(f) is called the inverse Fourier transform of Fim). 

Flere we have proven the fundamental theorem under the condition that / is 
piecewise smooth and absolutely integrable. There are many other conditions for 
which the theorem remains valid. It is, however, remarkable that up till now there 
are no known conditions for absolutely integrable functions that are both necessary 
and sufficient (in other words, a minimal condition) for the inversion formula (7.9) 
to be valid. 


A well-known continuous function which doesn’t satisfy the conditions of the fun¬ 
damental theorem is /(f) = sinf/f. Although this function is piecewise smooth 
(and even continuously differentiable), it is not absolutely integrable, as was men¬ 
tioned in section 6.3.1. ^ 
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If f(t) is an even function, then F(cu) is also even (see section 6.4.6). Since one 
then has for any A > 0 that 


£ 


; £ 


F(co) cos cot dco = 2 / F(co) cos cot dco and / F(co) sin cot dco = 0 


r 

J-A 


it follows that 

F(cu)e ia>t dco = 2 / F (w) cos cot dco 


L 


■f 


as a Cauchy principal value. For even functions we thus obtain the following version 
of the fundamental theorem: 


Fundamental theorem for 2 C™ p c(o)) cosa}t dw = I (/( , +) + /(,_)), (7.11) 

even functions it Jo 2 

where 

coo 

F c (co) = I f{t) cos a>t dt 
JO 

is the Fourier cosine transform of / (see section 6.4.6). Note that the integral in 
(7.11) is now an ordinary improper integral. When a function /(f) is only defined 
for t > 0, then, just as in section 6.4.6, one can extend the function / to an even 
function on R which will be denoted by /(f) again; formula (7.11) then holds for 
this even extension. 

For an odd function g(t) the function G(co) is odd and one obtains in a similar 
fashion a version of the fundamental theorem for odd functions: 

Fundamental theorem for odd 2 C°° ^ ^ = 1 + )} _ (7 . 12) 

junctions it Jo 2 

where 

COO 

G s (a>) = I g(t)sma>tdt 

Jo 

is the Fourier sine transform of / (see section 6.4.6). When a function is only 
defined for f > 0 and we extend it to an odd function on R, then (7.12) will hold for 
this odd extension. Of course, the conditions of the fundamental theorem should be 
satisfied in all of the preceding statements. 

Now that we have done the hard work in proving the fundamental theorem, we 
will reap the fruits of it in the next section. 


EXERCISES 

7.1 Verify for the spectra from the exercises in section 6.3 that the Riemann-Lebesgue 
lemma holds. 

7.2 Show that the Fourier transform of the block function p 2 A at the point co = s — t 
equals 2 sin(A(t — s))/(t — s) (see the derivation of (7.5) from (7.4)). 

7.3 Show that for arbitrary C > 0 one has 

f c sin An n 

lim / - du = — 

A—yooJo u 2 

(see step 1 in the proof of theorem 7.2). 
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7.4 


7.5 


7.6 


7.7 

7.8 


7.9 


Calculate in a direct way (so in contrast to example 7.1) the Cauchy principal value 
of 



1 

- da>. 

1 + ia> 


a Check that the block function p a (t) satisfies the conditions of the fundamental 
theorem and give the inversion formula. 

b Use (7.3) to show that the integral in the fundamental theorem of part a exists as 
improper integral. 


Let the function f(t ) be given by (see exercise 6.9b) 

. ( sinf for 1 1 1 < jr, 

0 elsewhere. 


a Check that fit) satisfies the conditions of the fundamental theorem and that 
F{m) exists as improper integral, 
b Prove that 

1 f 00 COS(7T — t)a> — COS(7T + t)w 

,- —dm. 

n Jo 1 -co 2 

Show that for an odd function the fundamental theorem can be written as in (7.12). 


Consider the function 


/(0 = 


1 for 0 < t < a, 
0 for t > a. 


a Use the Fourier sine transform of the function f(t) (see exercise 6.15b) to show 
that for t > 0 (t / fl) one has 


2 f°° 1 — cos am 

f(t)=— I - sinmtdm. 

n Jo m 

b To which value does the right-hand side of the identity in part a converge for 
t = a? 


The ordinary multiplication of real numbers has a unit, that is to say. there exists a 
number e (namely the number 1) such that ex = x for all r el. Now take as mul¬ 
tiplication of functions the convolution product f * g. Use the Riemann-Lebesgue 
lemma and the convolution theorem (theorem 6.13) to show that the convolution 
product has no unit. In others words, there does not exist a function e such that 
e* f = f for all /. (All functions are assumed to be bounded, absolutely integrable 
and piecewise smooth.) 


7.2 Consequences of the fundamental theorem 

In this section we use the fundamental theorem to derive a number of important 
additional properties of the Fourier transform. 


7.2.1 Uniqueness 

From the fundamental theorem we immediately obtain the uniqueness of the Fourier 
transform. 
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THEOREM 7.4 

Uniqueness theorem 


EXAMPLE 


Let f(t) and git) be absolutely integrable and piecewise smooth functions on R 
with spectra F(a>) and G(a>). If Fiat) = G{a>) on R, then fit ) = git) at all points 
where f and g are continuous. 

Proof 

Let t € R be a point where / and g are both continuous. Since F(a>) — G(a> ), it 
then follows from the fundamental theorem that 
1 I°° • 1 

f(t) = — / F(a))e l<ot da> = — G(co)e' co ' dco = git). 

^ J —oo ^ J—o o ^ 

The uniqueness theorem is often applied (implicitly) when addressing the follow¬ 
ing frequently occurring problem: given F(a>), find a function /(f) with spectrum 
F(a>). Let us assume that on the basis of a table, and perhaps in combination with 
the properties of the Fourier transform, we know a function /(f) indeed having 
F(a>) as its spectrum. (In most cases a direct calculation of the Fourier integral is 
not a very clever method.) Theorem 7.4 then guarantees that the function we have 
found is the only possibility within the set of absolutely integrable and piecewise 
smooth functions. This is up to a finite number of points (on an arbitrary bounded 
interval) where we can give the function / an arbitrary (finite) value (see figure 7.2). 
This is because if / and g are two functions with the same spectrum, then we can 
only conclude that (/(f+) + /(f—))/2 = (g(f+) + git— ))/2 at the points where 
/ and/or g are not continuous. These exceptional points are of little importance; 
however, in order to formulate results like the fundamental theorem accurately, one 
should keep them in mind. In some of the literature these exceptional points are 
avoided by assuming that at a point f e R where a piecewise smooth function is 
not continuous, the function value is always defined as (/(f+) + fit—))/ 2. In that 
case, theorem 7.4 is thus correct on R. This is the case, for example, for the function 
h in figure 7.2. 

We are looking for a function with spectrum F(a>) = 1/(1 + ico)~. This function is 
the product of 1/(1 + ico) with itself and from table 3 it follows that git) = e(t)e~' 
has as its spectrum precisely 1/(1 + ia>). From the convolution theorem (theorem 
6.13) it then follows that /(f) = (g * g)(t) has F(w) as its spectrum. It is easy to 
calculate the convolution product (see exercise 6.27) and from this it follows that 
f(t) = e(t)te~'. According to theorem 7.4 this is the only absolutely integrable 
and piecewise smooth function with spectrum F (o>). ^ 

The uniqueness theorem gives rise to a new notation. When /(f) is absolutely 
integrable and piecewise smooth, and when F{a>) is the spectrum of /(f), then we 
will write from now on 

fit) Fico). 

This expresses the fact that / and F determine each other uniquely according to 
theorem 7.4. As before, one should adjust the value of / in the exceptional points, 
where / is not continuous, as before. Often the following equivalent formulation of 
theorem 7.4 is given (we keep the conditions of the theorem): when F{a>) = 0 on R, 
then f(t) = 0 at all points t where / is continuous. This formulation is equivalent 
because of the linearity property (see section 6.4.1). 


7.2.2 Fourier pairs 

In section 6.3 the Fourier transforms were calculated for a number of frequently used 
functions. Using the fundamental theorem it will follow that Fourier transforms 
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FIGURE 7.2 

Three functions /, g and h with the same spectrum. 


usually occur in pairs, which immediately doubles the number of examples. Let 
us assume that a function f(t) with spectrum F(co) satisfies the conditions of the 
fundamental theorem. For convenience we also assume that /(f) is continuous, and 
according to theorem 7.3 we then have for each I el that 


/« = 



F(ai)e imt dm. 
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THEOREM 7.5 


Duality 

Reciprocity 


EXAMPLE 7.4 


THEOREM 7.6 


Let us moreover assume that this integral exists as an improper integral (which usu¬ 
ally is the case). Both t and a> are just variables for which one may as well choose 
another symbol. In particular we may interchange the role of t and a>, and it then 
follows that 

/(«) = — / F(t)e lmt dt. 

^ J —oo 

If we now change from the variable t to the variable —t we obtain 
1 

f(a»=—\ F{-t)e~ l(ot dt. (7.13) 

J—OO 

But this last integral is precisely the Fourier transform of the function F(—t)/2xt. 
Summarizing, we have proven the following theorem. 

Let /(f) be an absolutely integrable and piecewise smooth function on R with spec¬ 
trum F(a>). Assume that f is continuous and that the Fourier integral exists as an 
improper Riemann integral. Then 


F(—t) 2trf(co). 

Hence, Fourier transforms almost always occur in pairs. This property is called 
the duality or the reciprocity of the Fourier transform and is included as property 
11 in table 4. Do not confuse ‘duality' with the ‘selfduality’ from section 6.4.7. If 
the function /(f) is not continuous, but merely piecewise continuous, then (7.13) 
and the duality property will still hold, with the exception of the points where / is 
not continuous (there the left-hand side of (7.13) has to be adjusted). A special case 
arises when / is an even function. Then F is also an even function, from which it 
follows that in this case F(t) 2nf(w). 

Take /(f) = e~ a ^ ’ I as in example 7.2. This is an even and continuous function and 
F(co) is absolutely integrable. From theorem 7.5 we then obtain 

“ 7re~ a|tt)| , (7.14) 

a 2 + f 2 

and so we have found a new Fourier transform. ^ 


We called the mapping assigning Fourier transforms to functions the Fourier 
transform. For the distribution theory in chapters 8 and 9 it is important to know 
the image under the Fourier transform of the set S (5 is the set of rapidly decreas¬ 
ing functions; see section 6.5). In theorem 6.12 it was already shown that F(a>) e S 
for /(f) e S. In other words, the Fourier transform maps the space S into itself. 
Moreover, functions in S certainly satisfy the conditions of the uniqueness theorem; 
the Fourier transform is thus a one-to-one mapping in the space S. With the duality 
property one can now easily show that the image of S is the whole of S, in other 
words, the Fourier transform is also a mapping from S onto S. 

The Fourier transform is a one-to-one mapping from S onto S. 

Proof 

For a given function / e S we must find a function in the time domain having / as 
its spectrum. Now let F(a> ) be the spectrum of /(f). By theorem 6.12 the function 
F belongs to S and so it is certainly absolutely integrable (see the remark preceding 
theorem 6.12). All conditions of theorem 7.5 are thus satisfied and it follows that 
the function F(—t)/2jt e S has the function f(a>) as its spectrum. We have thus 
found the desired function and this proves theorem 7.6. g 
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EXAMPLE 7.5 


Probability distribution 


Normal distribution 


Sometimes theorem 7.6 is also formulated as follows: for each F(a>) e S there 
exists a (unique) /(f) e S such that F(to) is the spectrum of fit). We recall that 
/(f) is called the inverse Fourier transform of F(a> ) (see section 7.1). In particular 
we see that the inverse Fourier transform of a function in S belongs to S again (the 
‘converse’ of theorem 6.12). In the next example we apply theorem 7.6 to derive a 
well-known result from probability theory. 

2 

Application of the reciprocity property to the Gauss function e~ at will not result 
in a new Fourier transform, since the spectrum of the Gauss function has a similar 
form. Still, we will have a closer look at the Gauss function and the Fourier pair 




(7.15) 


From (6.15) it follows that 


/: 


i 


- f ! Aa dt = 1. 


Functions with integral over R equal to 1, which moreover are positive on 
called probability distributions in probability theory. If we now write 


Wait) = 


1 c ~f 2 /4« ; 
2^/tt a 


then W a is a positive function with integral over R equal to 1 and so a probability 
distribution. It is called the normal distribution. As an application of our results, we 
can now prove a nice and important property of the normal distribution, namely 


(Wa * w b )(t) = W a +b(t). (7.16) 

(For those familiar with stochastic variables, this result can be reformulated as fol¬ 
lows: if X and Y are two independent stochastic variables with normal distributions 
W a and W b , then X + Y has normal distribution W a + b .) To prove this result, we 
first apply the convolution theorem from section 6.6 and then use (7.15): 

TiWa * w b )(a» = (fW a )(co)(fW b )(co) 

= e~ au,2 e- bu? = e-t a + b *° 2 = (FW a+b )(o>). 

Since T(W a * W b ) e 5, the inverse Fourier transform W a * W b will also belong to 
S. Hence, both W a * W b and W a + b belong to S and (7.16) then follows from the 
uniqueness of the Fourier transform on the space S (theorem 7.6). ^ 


7.2.3 Definite integrals 

Using the fundamental theorem one can also calculate certain definite integrals. As 
an example we take the block function p a (t) with spectrum 2sin(aai/2)/a> (see 
table 3). Applying the fundamental theorem for t = 0, it follows that 

sin(aa>/2) , 

/ - dco — n. 

J-oo <*> 

Next we change to the variable t = aco/2 and use that the integrand is an even 
function. We then obtain 




7.2 Consequences of the fundamental theorem 


111 


EXAMPLE 7.6 


EXAMPLE 7.7 


Cauchy distribution 


DEFINITION 7.2 

Square integrable 


THEOREM 7.7 

Convolution theorem in the 
frequency domain 


which proves (7.3) again. Note, however, that in proving the fundamental theorem 
we have used (7.3), which means that we cannot claim to have found a new proof of 
(7.3). For other choices for the function fit), the fundamental theorem can indeed 
provide new results that may be much harder to prove using other means. Let us 
give some more examples. 

Let q a (t) be the triangle function with spectrum 4 sin 2 (aft>/2)/( aco 2 ) (see table 3 or 
section 6.3.2). Applying theorem 7.3 for f = 0 we obtain 


1 r°° 4sin 2 (ncn/2) 

2n J-o o aco 2 


dco = 1. 


Now change to the variable 1 = aco/2 and use that the integrand is an even function. 
We then find 


I" 00 sin 2 t 7r 

I ^ dt= 2 


(7.17) 

◄ 


Take /(f) = e a \ 1 L All preparations can be found in example 7.2: if we take f = 0 
and a = 1 in (7.10), and change to the variable t = co, we obtain 


/ 


- dt — n. 


—OO 1 + < 

(This result can easily be obtained in a direct way since a primitive of the integrand 
is the well-known function arctanf.) Now write for a > 0 

1 a 

Palt) = - 


7t a 2 + t 2 ' 


Then P a is a positive function with integral over R equal to 1 and so P a is a proba¬ 
bility distribution (see example 7.5); it is called the Cauchy distribution. ^ 


7.2.4 Convolution in the frequency domain 

In section 6.6 the convolution theorem (theorem 6.13) was proven: if /(f) -o- F(a >) 
and git) -o- G(a>), then ( f*g)(t ) -o- F(co)G(co). The duality property suggests that 
a similar result should hold for convolution in the frequency domain. Under certain 
conditions on the functions / and g this is indeed the case. Since these conditions 
will return more often, it will be convenient to introduce a new class of functions. 

A function f : R -*■ C is called square integrable on R if I fit) | 2 dt exists as 
improper Riemann integral. 

If a function / is absolutely integrable, then it need not be square integrable. For 
example, the function /(f) = P 2 (t) I f p 1 / 2 is absolutely integrable, but not square 
integrable since 1 1 1 -1 is not integrable over the interval — 1 < t < 1. One now has 
the following convolution theorem in the frequency domain. 

Let fit) and git) be piecewise smooth functions which, in addition, are absolutely 
integrable and square integrable on R. Then 

fit)git)^i2n)- l (F*G)ico). 

Proof 

We give the proof under the simplifying assumption that the spectra F(co) and G(w) 
exist as improper Riemann integrals. Since (a + b) 2 = a 2 + 2ab + b 2 >0, we 
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EXAMPLE 


see that [ /(f)g(f) \ < |(l /(f) \~ + \ g(t) | 2 ) for all t e R. Since / and g are 
square integrable, it now follows that f(t)g(t) is absolutely integrable. Hence, the 
spectrum of f(t)g(t ) will certainly exist. According to the fundamental theorem we 
may replace f(t) in 


T(f(t)g(t))(eo) = 



f(t)g(t)e- Uot dt 


by 

i r°° 

— / F(x)e IT 'dx, 

2ff J—o o 

where we may consider this integral as an improper Riemann integral (the excep¬ 
tional points, where /(f) is not equal to this integral, are not relevant since we 
integrate over the variable f). It then follows that 

1 poo poo 

T(f(t)g(t))(co) = — / / F(T)g(t)e- i(a, - z)r dxdt 

Zn J—oo J—oo 

i r°° / r°° \ 

= — / (/ g(t)e- ,( 0 , - T), dt)F(T)dT , 

J—oo \J—oo / 

where we have changed the order of integration. We state without proof that this 
is allowed under the conditions of theorem 7.7. We recognize the inner integral as 
G(co — t). This proves theorem 7.7, since it follows that 

Hf(t)g{mco) = -L [°° F{t)G{co - T) dx = t—(E * G)(eo). 

Zjt J—oo 


For complicated functions one can now still obtain the spectrum, in the form of a 
convolution product, by using theorem 7.7. In some cases this convolution product 
can then be calculated explicitly. 

Suppose we need to find the spectrum of the function (1 + f 2 ) -2 . In example 7.4 we 
showed that 1/(1 + f 2 ) -o- ixe~^ “ I and since all conditions of theorem 7.7 are met. it 
follows that (1 +f 2 ) -2 -o- (7r/2)(e _ l T Ue - I T !)(«). By calculating the convolution 
product (see exercise 6.26a), it then follows that (1+/ 2 ) -2 -o- (7r/2)(l+|ai|)e _ l‘ u L 

◄ 


7.2.5 Parseval’s identities 


In theorem 7.7 it was shown that 


/: 


/ (t)g(t)e~ dt= — 


=—r 

2tt y_ ( 


F(r)G(a> — x) dx 


and at the point a> = 0 this gives the identity 


£ 


f(t)g(t)dt = — 


If 

2fr J_, 


F(x)G(—x) dx. 


Now replace g(f) by g(f) and use that g(f) -o- G(—a>) (see table 4). then it follows 
that 


£ 


/ (t)g(t) dt = 


1 r 

“ 2 n J-, 


F(a>)G(a>) da>. 


(7.18) 
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Parseval’s identity 


Plancherel’s identity 


Energy-signal 

Energy-content 


EXAMPLE 


EXAMPLE 


7.10 

7.11 

7.12 


This result is known as the theorem of Parseval or as Parseval’s identity and it thus 
holds under the same conditions as theorem 7.7 (taking the complex conjugate has 
no influence on the conditions). Since zz = \z\~ for zeC, formula (7.18) reduces 
for fit) = g(t) to 



\f(t)\ 2 dt = 


1 

— I F(a) C da>. 

^ «/—OO 


(7.19) 


In order to distinguish between formulas (7.18) and (7.19) one often calls (7.19) 
Plancherel’s identity. We shall not make this distinction: both identities will be 
called Parseval’s identity. (Compare (7.18) and (7.19) with Parseval’s identities for 
Fourier series.) Note that in (7.19) it is quite natural to require fit) to be square 
integrable. 

Identity (7.19) shows that square integrable functions have a Fourier transform 
that is again square integrable. In signal theory a square integrable function is 
also called a signal with finite energy-content or energy-signal for short. The value 
Ho | f(t) | 2 dt is then called the energy-content of the signal f(t) (also see chap¬ 
ter 1). Identity (7.19) shows that the spectrum of an energy-signal has again a finite 
energy-content. 

ParsevaTs identities can also be used to calculate certain definite integrals. 


Again we consider the block function p a (t) from section 6.3.1 having spectrum 
2sm(ato/2)/a>. The function p a satisfies the conditions of theorem 7.7 and from 
(7.19) it then follows that 



I Pa(t) | 2 dt = 


1 4sin 2 (aw/2) , 

2?r J- oo at 2 


The left-hand side is easy to calculate and equals a. Changing to the variable t — 
aco/2 in the right-hand side, we again obtain the result (7.17) from example 7.6. ^ 


In (7.18) we take fit) — p a (t) and git) = pbit) with 0 < a < b. It then follows 
that 

1 4smiaco/2)smibco/2) 

/ Pait)Pb(t)dt = — - ~ - dm. 

7-00 2jr 7-oo a> 

The left-hand side equals a (since a < b), while the integrand in the right-hand side 
is an even function. Hence, 

sin(flw/2) sin(7>a>/2) tz 

/ -—s- -da)=—a. 

Jo a? 4 

Now change to the variable t — aa>/2. then it follows for any c (= b/a) > 1 that 
sinf sincf n 

L t 2 dt = ^2 

The previous example is the case a = b — 1. ^ 


EXERCISES 


Show that theorem 7.4 is equivalent to the following statement: if Fia>) = 0 on R, 
then fit) = 0 at all points t where / is continuous. 

Use the duality property to determine the Fourier transform of the function 
sin(af/2)/f. Also see exercise 7.5, where we already verified the conditions. 

Use the duality property to determine the Fourier transform of the function 
sin 2 iat /2) / 1 2 . 
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7.13 

7.14 

7.15 


7.16 

7.17 

7.18 

7.19 

7.20 

7.21 


7.22 


7.23 


Use the convolution theorem in the frequency domain to determine the spectrum of 
the function sin 2 (at/2)/t~ (see section 6.6 for p a * p a ). Check your answer using 
the result from exercise 7.12 and note that although sin(flf/2)/f is not absolutely 
integrable, theorem 7.7 still produces the correct result. 

According to table 3 one has for a > 0 that e{t)e~ at <-> l/(a + iu>). Can we now 
use duality to conclude that \/{a + it) -o- 2ne(—a>)e aw 2 

Verify that the duality property applied to the relation 

e - a f- ^ JfL e -co 2 /4a leads tQ the resuk _J_ e -t 2 /4a ^ g -aco 2 
V a 2*f7ta 

Then show that the second relation is a direct consequence of the first relation by 
changing from a to 1/(4 a) in the first relation. Hence, in this case we do not find a 
new Fourier transform. 


Determine the Fourier transform of the following functions: 
a /(f) = l/(r 2 - 2t + 2), 
b /(f) = sin2w(f - 3)/(f - 3), 
c /(f) = sin4f/(f 2 —4 f + 7), 
d /(f) = sin 2 3(f — 1)/(f 2 — 2f + 1). 

Determine the function /(f) having the following function F(oj) as its spectrum: 

a F(a>) = l/(ar + 4), 

b F(a>) = P2a (« - a> o) + P2a (&> + too) f° r a > 0- 
c F(a>) = 3|91 


Let / and g be two functions in S. Use the convolution theorem (theorem 6.13) and 
theorem 7.6 to show that f * g belongs to S. 

Let P a (t) be as in example 7.7. Show that P a * Pj, = P a +b- Here one may use that 
P a * P[, is continuously differentiable (P a is not an element of S; see exercise 6.20). 


Consider the Fourier transform on the space 5. Use the reciprocity property to show 
that JF 4 is the identity on S (up to a constant): 7 r4 (/(f)) = 4jr 2 /(f) for any / e S. 

For f > 0 we define the function g(f) by g(f) = e~'. Extend this function to an odd 
function on R. The spectrum of g has been determined in exercise 6.14. 
a Use the fundamental theorem to show that for f > 0 one has 

x sin xt Jt 

Jo 1 + x 2 2 

Why is this identity not correct for f = 0? 
b Next use Parseval’s identity to show that 



(1 + x 2 ) 2 



Use the function e 1 ^ to show that 



1 

(a 2 + x 2 )(b 2 + x 2 ) 


TC 

2 ab(a + b) 


a Determine the spectrum of the function sin 4 f/f 4 using the convolution theorem 
in the frequency domain, 
b Calculate 



■ 4 
sin x 


dx. 



7.3 Poisson's summation formula' 
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7.24 


THEOREM 7.8 

Poisson’s summation formula 


Find the function /(f) with spectrum 1/(1 + a> 2 ) 2 and use this to give a new proof 
of the identity from exercise 7.22 for the case a = b — 1. 


7.3 Poisson’s summation formula* 

The material in this section will only be used to determine the Fourier transform 
of the so-called comb distribution in section 9.1.3 and also to prove the sampling 
theorem in chapter 15. Sections 7.3 and 9.1.3 and the proof of the sampling theorem 
can be omitted without any consequences for the remainder of the material. 

With the conclusion of section 7.2 one could state that we have finished the the¬ 
ory of the Fourier integral for non-periodic functions. In the next two chapters we 
extend the Fourier analysis to objects which are no longer functions, but so-called 
distributions. Before we start with distribution theory, the present section will first 
examine Poisson's summation formula. It provides an elegant connection between 
the Fourier series and the Fourier integral. Moreover, we will use Poisson’s summa¬ 
tion formula in chapter 9 to determine the Fourier transform of the so-called comb 
distribution, and in chapter 15 to prove the sampling theorem. We note, by the way, 
that in the proof of Poisson's summation formula we will not use the fundamental 
theorem of the Fourier integral. 

In order to make a connection between the Fourier series and the Fourier integral, 
we will try to associate a periodic function with period T with an absolutely inte- 
grable function /(f). We will do this in two separate ways. First of all we define the 
periodic function / p (f) in the following obvious way: 

oo 

/p(o = Y, ( 7 - 2 °) 

n=—oo 

Replacing t by t + T in (7.20), it follows from a renumbering of the sum that 

oo oo 

fp(t + T)= J2 f(t + (n + l)T)= J2 f(t + nT) = f p (t). 
n ——oo n=—oo 

Hence, the function /p(0 is indeed periodic with period T. There is, however, 
yet another way to associate a periodic function with /(f). First take the Fourier 
transform F(a>) of f(t) and form a sort of Fourier series associated with / (note 
again that / is non-periodic): 

1 °° 

- J2 F(2nn/T)e 27Tin,/T . (7.21) 

n=—o o 

(We will see that this is in fact the Fourier series of fp(t).) If we replace t by 
t + T, then (7.21) remains unchanged and (7.21) is thus, as a function of f, also pe¬ 
riodic with period T. (We have taken FFinn IT) / T instead of F(n) since a similar 
connection between Fourier coefficients and the Fourier integral has already been 
derived in (6.9).) Poisson's summation formula now states that the two methods to 
obtain a periodic function from a non-periodic function /(f) lead to the same result. 
Of course we have to require that the resulting series converge, preferably abso¬ 
lutely. In order to give a correct statement of the theorem, we also need to impose 
some extra conditions on the function /(f). 

Let /(f) be an absolutely integrable and continuous function on R with spectrum 
F(co). Let T > 0 be a constant. Assume furthermore that there exist constants 
p > 1, A > 0 and M > 0 such that \ f{t) \ < M \t \~P for \ t \ > A. Also assume 
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that YlwL-oo I F(2nn/T) \ converges. Then 

OO 1 oo 

X f(t + nT) = — X F(27tn/T)e 27lin,/T (7.22) 

n =—oo n=—o o 

(with absolutely convergent series). In particular 

oo 2 00 

Z fw = T E F(2nn/T). (7.23) 

n=—o o n=—o o 

Proof 

Define / p (f) as in (7.20). Without proof we mention that, with the conditions on the 
function /(f), the function /p(f) exists for every (el and that it is a continuous 
function. Furthermore, we have already seen that /p(f) is a periodic function with 
period T. The proof now consists of the determination of the Fourier series of fpit) 
and subsequently applying some of the results from the theory of Fourier series. 

For the /ith Fourier coefficient c n of / p (f) one has 

cn= l ~ [ T f P (t)e- 2 * in '/ T dt= X - f T f) f(t + kT)e~ 2nint ! T dt. 

Integrating term-by-term we obtain 
, oo r T 

c„ = - E / f(t + kT)e- 2nln, ' T dt. 

From the conditions on the function /(f) it follows that this termwise integration is 
allowed, but again this will not be proven. Changing to the variable r = f + kT in 
the integral, it then follows that 

fir)e- 27tinT / T e 27link dr. 

Vovk,n e Z one has e 2llink = 1. Furthermore, the intervals [kT, (k+ 1)7"] precisely 
fill up all of M when k runs through the set Z, and so 

1 1 

C„ = - / f(T)e- 2ninr l T dr = -Filnn/T). (7.24) 

This determines the Fourier coefficients c n of /p(f ) and because of the assumption 
on the convergence of the series Y^nL-oo I FQjtn / T) \ we now have that 

oo 

| c n | converges. 

n=—o o 

Since | c n e 2n ' nt / T | = \c n |, it then also follows that the Fourier series of /p(f) 
converges absolutely (see theorem 4.5). For the moment we call the sum of this 
series g(f), then g(t) is a continuous function with Fourier coefficients c n . The 
two continuous functions / p (f) and git) thus have the same Fourier coefficients and 
according to the uniqueness theorem 4.4 it then follows that /p(f) = git). Flence, 

OO J oo 

X) fit + nT) = /p(f) = git) — — X Fi2nn/T)e 2nint ' T , 

n =—oo n=—oo 


c n — j. 


1 _°°. r 

f ^ L 

k=—o o 


(k+l)T 

kT 
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EXAMPLE 7.8 


which proves (7.22). For r = 0 we obtain (7.23). 


In the proof of theorem 7.8 a number of results were used without proof. All 
of these results rely on a property of series - the so-called uniform convergence - 
which is not assumed as a prerequisite in this book. The reader familiar with the 
properties of uniform convergent series can find a more elaborate proof of Poisson’s 
summation formula in, for example, The theory of Fourier series and integral by 
PL. Walker, Theorem 5.30. 

We will call both (7.22) and (7.23) Poisson's summation formula. Front the proof 
we see that the right-hand side of (7.22) is the Fourier series of fp(t), that is, of the 
function /(f) made periodic according to (7.20). The occurring Fourier coefficients 
are obtained from the spectrum F(a>) using (7.24). In this manner we have linked 
the Fourier series to the Fourier integral. It is even possible to derive the fundamental 
theorem of the Fourier integral from the fundamental theorem of Fourier series using 
Poisson’s summation formula. This gives a new proof of the fundamental theorem 
of the Fourier integral. We will not go into this any further. In conclusion we present 
the following two examples. 

Take//) = a/(a 2 + t 2 ) witha > 0, then F(a>) — ne~ a ^ 0 ^ (see table 3). We want 
to apply (7.23) with T = 1 and so we have to check the conditions. The assumption 
about the convergence of the series Xl«^L-oo I F(2jrn) | is easy since 


E 


e -2na\n \ 


n=—o o 


oo 

1 + 2 Y_ e - l7la '\ 

n= 1 


which is a geometric series with ratio r = e~ 2na . Since a > 0 it follows that 
\r\ < 1, and so the geometric series converges (see section 2.4.1). In this case we 
even know the sum: 


E 


g -2na\n \ 


n =—oo 


1 + 2 - 
1 


e -2na 
_ g—Tjza 


1 + e~ 27la 
1 - e~ 2jTa ' 


The condition on the function /(f) is also easy to verify: for f / 0 one has | /(f) | < 
a/t 2 and so the condition in theorem 7.8 is met if we take p = 2, M = a and A > 0 
arbitrary. Poisson's summation formula can thus be applied. The right-hand side of 
(7.23) has just been calculated and hence we obtain 

^ 1 n 1 + e~ 2na 

7 - 7 =- o—• (7.25) 

a 2 + n 2 a 1 - e 27Ta 


By rewriting (7.25) somewhat, it then follows for any a > 0 that 


E 

n= 1 


1 


n 1 + e 


—2 na 


a 2 + n 2 2a l — e 2lTa 


1 

2a 2 


Now take the limit a / 0, then the left-hand side tends to Yl'nL l l/ w > while a little 
calculation will show that 

r ( Tt l+e~ 2na 1 \ r na(l + e~ 2jra ) — (1 — e~ 27la ) n 2 
4o \2a 1 - e ~ 27Ta 2a 2 / a™ 2a 2 (l - e~ 27la ) ~ 6 

(apply, for example, De l'Hopital’s rule three times). This gives a new proof of the 
famous identity (also see exercise 4.8) 

•E n 2 6 

n= 1 


◄ 
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EXAMPLE 7.9 


Every rapidly decreasing function /(f) (see section 6.6) satisfies the conditions of 
theorem 7.8. First of all, it follows straight front the definition of the notion ‘rapidly 
decreasing' that the condition on the function /(f) is met, since for /(f) one has, 
for example, that there exists a constant M > 0 such that | /(f) | < M/t 2 for all 
f / 0 (so we can choose p = 2 and A arbitrary positive). It only remains to be 
shown that the series YZiL-oo I F(2tzn/T) | converges. Now it has been proven in 
theorem 6.12 that the spectrum F(a>) of /(f) is again a rapidly decreasing function. 
In particular, there again exists a constant M > 0 such that | F(a>) | < M/ar for all 
»/0. Hence, 

oo oo —1 

Y \F(2nn/T)\ = \F(0)\ + Y\F(2nn/T)\+ Y \F(2nn/T)\ 
n =—oo n= 1 n=—o o 



since n ~~ converges. All the conditions of theorem 7.8 are thus satisfied 

and so Poisson's summation formula can be applied to any f e S. This result will 
be used in section 9.1.3 to determine the Fourier transform of the so-called comb 
distribution. ^ 

EXERCISES 

7.25* Show that (see example 7.8) 

nail + e ~ 2na ) - (1 - e~ 2lTa ) _ n 2 
4o 2a 2 (l - e~ 27la ) ~ 6 ' 

7.26* Indicate why Poisson’s summation formula may be applied to the function /(f) = 

2 

e~ at (a > 0). Then prove that for every x > 0 one has 

oo oo 

Y e~ 7rn x = X - 1/2 Y e ~ nn /X - 

n =—oo n=—o o 

7.27* Prove the following generalization of (7.25) (here sinhx = (e x — e~ x )/2 and 

coshx = (e x + e - - Y )/2): 

a -^2, 1 sinh2fra 

n t— 1 a 2 + (n + f) 2 cosh 27ra — cos 2nt 
n=—oo v ' 


SUMMARY 

For an absolutely integrable and piecewise continuous function /(f) on R with spec¬ 
trum F(aj ) one has lim w _ s .± 00 F(a>) = 0 (Riemann-Lebesgue lemma). Using this 
important property, the fundamental theorem of the Fourier integral was proven: 

1 • 1 
— / F( W y wr dot = - (/(f+) + f{t-)) 

Ztt J—oo Z 

for any absolutely integrable and piecewise smooth function fit) on R (from now 
on, all functions in the time domain will be assumed to be absolutely integrable and 
piecewise smooth on R). Here the Fourier integral in the left-hand side converges 
as a Cauchy principal value. 
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7.28 


From the fundamental theorem the uniqueness of the Fourier transform on R 
immediately follows: if F(a>) = G(a>) on R, then f(t) = g(f) at all points t where 
/ and g are continuous. 

In many cases the Fourier integral will exist as an improper integral as well, 
resulting in the duality or reciprocity property: 

F(-t) 2 nf(co). 

Because of this, Fourier transforms almost always occur in pairs. The duality prop¬ 
erty certainly holds for rapidly decreasing functions and this was used to show that 
the Fourier transform is a one-to-one mapping onto the space S of rapidly decreas¬ 
ing functions. 

For square integrable functions / and g on R, the fundamental theorem was used 
to prove the convolution theorem in the frequency domain: 


f(t)g(t) (F*G)(oo)/2jr. 


From this, Parseval's identities immediately follow: 


/ oo 

-00 


-oo 

and 


2n J- 


f(t)g(t)dt= — F(a>)G(co) da) 


/ OO 

-oo 


\mrdt = — 


If 

2n J_, 


| F(co) r da). 


Both the fundamental theorem and Parseval's identities can be used to determine 
definite integrals. 

Finally, Poisson's summation formula 


1 


E f(t + nT)=- J2 F(2nn/T)e 


2jt int j T 


(where T > 0 is a constant) provided a link between Fourier series and the Fourier 
integral. This formula can, for example, be applied to any / e S. 


SELFTEST 

The function /(f) is defined by 

sinf forO<f<jr, 

( 0 elsewhere. 

(see exercise 6.9 for a similar function), 
a Determine the spectrum F( w) of /(f). 
b Show that for each f e R one has 

1 cos(?r — t)co + cos tea 

fit) = - / ---5- da). 

n Jo 1 - a) 1 

c Prove that 

cos(7r.r/2) n 

Jo 1 - x - 2 

d Finally show that 
f°° cos 2 (7r.r/2) n 2 

k 7T3^r‘" = T' 
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7.29 


7.30 


Let the function f(t) = s'mat/(t(l + r 2 )) (a > 0) with spectrum F(a>) be given. 
Find F(a >) explicitly as follows. 

a Show that g(t) = (P2n( v ) * e ~ v ^(O has as spectrum G(a>) = 4f(a>). 
b Determine g(t) explicitly by calculating the convolution from part a. 
c Verify that the duality property can be applied and then give F(to). 

Let q a (t) be the triangle function and p a (t) the block function (a > 0), then it is 
known that (see table 3) 


9a (0 


4 sin 2 (aa>/2) 


Pa(t) 


2 sin(a<w/2) 


a For which values of t e R does the Fourier integral corresponding to q a (t ) 
converge to q a (t) r ! Does this Fourier integral converge only as Cauchy principal 
value or also as improper integral? Justify your answers, 
b Use Parseval’s identity to show that 
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CHAPTER 8 


Distributions 


INTRODUCTION 


Many new concepts and theories in mathematics arise from the fact that one is con¬ 
fronted with problems that existing theories cannot solve. These problems may 
originate from mathematics itself, but often they arise elsewhere, such as in physics. 
Especially fundamental problems, sometimes remaining unsolved for years, decades 
or even centuries, have a very stimulating effect on the development of mathemat¬ 
ics (and science in general). The Greeks, for example, tried to find a construction 
of a square having the same area as the unit circle. This problem is known as the 
‘quadrature of the circle" and remained unsolved for some two thousand years. Not 
until 1882 it was found that such a construction was impossible, and it was discov¬ 
ered that the area of the unit circle, hence the number n, was indeed a very special 
real number. 

Many of the concepts which one day solved a very fundamental problem are now 
considered obvious. Even the concept of ‘function’ has one day been heavily de¬ 
bated, in particular relating to questions on the convergence of Fourier series. Prob¬ 
lems arising in the context of the solutions of quadratic and cubic equations were 
solved by introducing the now so familiar complex numbers. As is well-known, the 
complex numbers form an extension of the set of real numbers. 

In this chapter we will introduce new objects, the so-called ‘distributions’, which 
form an extension of the concept of function. For twenty years, these distributions 
were used successfully in physics, prior to the development, in 1946, of a mathe¬ 
matical theory which could handle these problematic objects. It will turn out that 
these distributions are an important tool, just as the complex numbers. They are 
indispensable when describing, for example, linear systems in chapter 10. 

In section 8.1 we will show how distributions arise in the Fourier analysis of 
non-periodic functions. We will first concentrate on the so-called delta function - a 
misleading term by the way, since it is by no means a function. In section 8.2 we 
then present a mathematically rigorous introduction of distributions, and we treat our 
first important examples. We will show, among other things, that most functions can 
be considered as distributions; hence, distributions form an extension of functions 
(although not every function can be considered as a distribution). 

It is remarkable that distributions can always be differentiated, as will be estab¬ 
lished in section 8.3. In this way, one can obtain new distributions by differentiation. 
In particular one can start with an ordinary function, consider it as a distribution, and 
then differentiate it (as a distribution). In this manner one can obtain distributions 
from ordinary functions, which themselves can then no longer be considered as 
functions. For example, the delta function mentioned above arises as the derivative 
of the unit step function. In the final section of this chapter two more properties 
will be developed, which will be useful later on: multiplication and scaling. Fourier 
analysis will not return until chapter 9. 
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LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know and can apply the definition of distributions 

- know how to consider functions as distributions 

- know the definition of a number of specific distributions: the delta function, the 
principal value l/t 

- know how to differentiate distributions 

- can add distributions and multiply them by a constant 

- can multiply distributions by polynomials and some more general functions 

- can scale distributions and know the concept of time reversal for distributions 

- know the concepts even and odd distributions. 


8.1 The problem of the delta function 


Without any doubt, the most famous distribution is the ‘delta function'. Although 
the name suggests otherwise, this object is not a function. This is because, as we 
shall see in a moment, a function cannot have the prescribed properties of the delta 
function. A precise definition of the delta function will be given in section 8.2. First 
we will show that the notion of the delta function arises naturally in the Fourier 
analysis of non-periodic functions. 

In section 6.2 we already noted that the constant function f(t) = 1 has no Fourier 
transform. However, a good approximation of / is the block function P 2 a (t) f° r 
very large values of a and in fact we would like to take the limit a —» oo. Since the 
spectrum of P 2 a (t) is the function 2sinaa>/a>, we will be inclined to believe that 
from this we should get the spectrum of the function f(t) = 1 as a —» oo. But what 
precisely is lim a _>.oo 2 sin aco/tol When this is considered as a pointwise limit, that 
is, for each Kiel fixed, then there is no value of to such that the limit exists, since 
liniv-^oo sinx does not exist. If we want to obtain a meaningful result, we need to 
attach a different meaning to the limit lim a ^oo 2 sin aco/to. Now in theorem 7.2 we 
have shown that for an absolutely integrable and piecewise smooth function one has 

1 rOO cjt-1 si y 

lim - - f(t-T)dx = f{t), (8.1) 

a^oo n J -00 T 

where we assume for convenience that / is continuous at t. By substituting t = 0 
and changing from the variable r to —to, we obtain that 

1 sin aco 

lim-/ - f(co)dco = f(0) (8.2) 

a^oo n J-oo to 


when / is continuous at t = 0. This enables us to give a new interpretation for 
liniu^oo 2 sinaw/ai: for any absolutely integrable and continuously differentiable 
function f(to) formula (8.2) is valid. Only within this context will the limit have a 
meaning. There is no point in asking whether we may interchange the limit and the 
integral in (8.2). We have come up with this new interpretation precisely because 
the original limit lim a _>.c>o 2 sin au>/a> had no meaning. Still, one often defines the 
symbol 8 (to) by 


8(to) = 


1 2 sin a to 

— lim - 

2jr a-*o o co 


(8.3) 


and then the limit and the integral are interchanged in (8.2). For the new object 5(w) 
one then obtains 



8(a»f(to)doo= f( 0). 


(8.4) 
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Formulas (8.3) and (8.4) should not be taken literally; the limit in (8.3) does not 
exist and (8.4) should only be considered as a symbolic way of writing (8.2). Yet, in 
section 8.2 it will turn out that the object 5(a>) can be given a rigorous mathematical 
meaning that is very close to (8.4). And although 8(co) is called the delta function, 
it will no longer be a function, but a so-called ‘distribution'. The general theory of 
distributions, of which the delta function is one the most important examples, will 
be treated in a mathematically correct way in the next section. 

We recall that studying the limit lim fl _*.oo 2 sin act)/u> was motivated by the search 
for the spectrum of the constant function fit) = 1. Since we can write 2jt8(co) = 
lintfl-^oo 2 sin aco/co, taking (8.3) as starting point, it is now plausible that 27r<5(<x>) 
will be the spectrum of the constant function /(f) = 1. 

Conversely, it can be made plausible in a similar way that the spectrum of the 
delta function 5(f) is the constant function F(co) = 1. To do so, we will take a closer 
look at (8.4) (which, by the way, is often taken as the defining property in much 
of the engineering literature). For example, (8.4) should be valid for absolutely 
integrable and piecewise smooth functions which, moreover, are continuous at t = 
0. The function 


fit) = 


1 fora < f < b, 
0 elsewhere. 


satisfies all these conditions as long as a 0 and b 0. Front (8.4) it then follows 
that fb 8(co) dco = /(0) for all a, b el with a ^ 0, fc / 0 and a < b. If we now 
take a < 0 and b > 0, then /(0) = 1 and so fj’ 8(a>) dco = 1. This suggests that 
the integral of the delta function over R equals 1, that is. 


/: 


8(a>) dco = 1. 


(8.5) 


If, on the other hand, we take a < b < 0 or 0 < a < b, then /(0) = 0 and so 



8(co) dco = 0 


for all a, b e R with a<b<0or0<a<b. 


( 8 . 6 ) 


A function satisfying both (8.5) and (8.6) must have a very extraordinary behaviour! 
(Based on (8.5) and (8.6) one can, for instance, conclude that there is not a single 
point in R where 8(oj) is continuous.) Sometimes this is solved by describing the 
delta function as a function being 0 everywhere, except at the point co = 0 (in order 
for (8.6) to hold) and in addition having integral over R equal to 1 (in order for (8.5) 
to hold). However, such a function satisfying (8.5) and (8.6) cannot exist since an 
integral does not change its value if the value of the integrand is changed at one 
point. Hence, the value of 5 (co) at the point co = 0 is not relevant for the integral as 
a whole, which means that the integral will be 0 since 8(co) — 0 outside the point 
co = 0. 

The above description of the delta function still has some useful interpretations. 
Let us consider the block function a~ l p a (t) of height a~ l and duration a for ever 
decreasing a (see figure 8.1). (For small values of a we can interpret p a (t) 
physically as an impulse: a big force applied during a short time.) For o ) Owe 
obtain an object equal to 0 everywhere except at the point t = 0 where the limit 
will be oo: moreover, the integral over R of a -1 p a (t) will equal 1 for all a > 0, 
and so in the limit a J, 0 the integral over R will equal 1 as well. We thus obtain 
an object satisfying precisely the description of the delta function given above. It is 
then plausible that 


/ oo 

-oo 


Pa(t) f (t) dt = /( 0 ), 


(8.7) 
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FIGURE 8.1 

Block functions approximating the delta function. 


and looking at (8.4) we are thus led to believe that 

lima _1 p a (f) = 5(f). 

<40 


( 8 . 8 ) 


As a matter of fact, one can prove that (8.7) is indeed correct, under certain con¬ 
ditions on the function /(f). Formulas (8.7) and (8.8) now present us with a sit¬ 
uation which is entirely analogous to the situation in (8.2) and (8.3). We can use 
this to make it plausible that the spectrum of the delta function 5(f) is the con¬ 
stant function F(a>) = 1. This is because the spectrum of a -1 p a (t) is the function 
(2 sin aco/2)/am and for arbitrary a> e R one has lim a m sin aco/aa> = 1. We thus 
indeed find that the spectrum of 5(f) = lim^o a~ 1 Pa(t) will equal the constant 
function F(a>) = 1 (this also follows if we interchange limit and integral in (8.7) 
and take e~ la>t for the function /(f)). Also note that the duality or reciprocity prop¬ 
erty of the Fourier transform seems to hold for the delta function as well: 5(f) -o- 1 
and 1 -o- 2rrS(a>). 

Of course, all the conclusions in this section rest upon intuitive derivations. In the 
next section a mathematically rigorous definition of distributions, and in particular 
of the delta function, will be given. In chapter 9 all of the results on the Fourier 
analysis of the delta function described above will be proven and the more general 
theory of the Fourier transform of distributions will be treated. 
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8.1 


EXERCISE 


There are many ways to obtain the delta function as a symbolic limit of functions. 
We have already seen two of these limits (in (8.3) and (8.8)). Now consider the 
function P a (t ) from example 7.7: 


Pa(t) = 


a 

n(a 2 + t-) 


a Sketch nP a (t) for a — 1 and a = 1/4. 

b Show that lim fl jo P a (t) = 0 for / / 0, while the limit equals oo for t = 0. 
Since the integral of P a (t) overR is 1 (see example 7.7), it is plausible that 5(f) = 
liiMo Pa(t). 

c Determine the limit of the spectrum of P a ( t ) for a l 0 and conclude that it is 
plausible that the constant function 1 is the spectrum of 5(f). 


8.2 Definition and examples of distributions 

8.2.1 Definition of distributions 


Loosely speaking, a complex-valued function / is a prescription assigning a value 
/(f) e C to every f e R. Complex-valued functions are thus mappings from R 
to C. In section 8.1 we have seen that the expression lim fl _j.oo 2 sinaa>/a> only 
makes sense in the context of the integral in (8.2). In fact, (8.2) assigns the value 
27r/(0) to every absolutely integrable and, say, continuously differentiable func¬ 
tion /(o>). Here we have discovered an important new principle: the expression 
limn-j.oo 2 sin aa>/a> (written symbolically as 2n8(a>)) can be considered as a map¬ 
ping assigning to every absolutely integrable and continuously differentiable func¬ 
tion /(o>) a certain complex number (namely 2nf (())). This new principle will be 
used to give a mathematically rigorous definition of distributions. 

Keeping in mind the Fourier analysis of distributions, it turns out that it is not 
very convenient to work with continuously differentiable functions. In order to get 
a nice theory it is necessary to use a set of functions which is mapped into itself 
by the Fourier transform. We already know such a set of functions, namely the set 
S of rapidly decreasing functions (see sections 6.5 and 7.2.2). Now distributions 
will be mappings assigning a complex number to every / e S. The choice of S is 
determined by its usefulness in Fourier analysis. It is quite possible to define certain 
distributions as mappings from other sets of functions to C, for example from the set 
of all continuous functions, or the set of all continuously differentiable functions, to 
C. However, we will mainly confine ourselves to mappings from S to C. 

One additional condition is imposed on these mappings: linearity. We will illus¬ 
trate this using our example from section 8.1. If we replace / in (8.2) by cf, where 
c is an arbitrary complex constant, then c can be taken outside the integral as well 
as outside the limit. Hence, we assign to the function c ■ f the complex number 
c ■ 2tt/(0). So, if we multiply / by c, then the complex number 2jr/(0) assigned to 
/ is also multiplied by c. Next we replace / in (8.2) by a sum g + h of two functions 
g and h. Then 


lim f 

a —>oo J_ 


°° 2 sin aco 
oo 


= lim [ 

a—>oo 


-oo 01 
= 2ng{0) + 2nh{0). 


(g + b)(a>) dto 

g(co)da)+ lim 


a> 

00 2sinfl£<; 


L 


00 2 sin aco 


■ h(ct>) da> 
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DEFINITION 8.1 
Distribution 


DEFINITION 8.2 

Delta function 


Sifting property 


Hence, we assign to the sum g + h the sum 2n(g + h)(0) of the complex numbers 
2ng(0) and 2nh(0). Together, these two properties show that the mapping is lin¬ 
ear (see also chapter 1 on linear systems). This finally brings us to the following 
definition of the concept of distribution. 

A distribution T is a linear mapping assigning a complex number to every rapidly 
decreasing function (j>. 

We denote the image of a fi e S under the mapping T by (T,fi)\ note that 
{T, fi) e C. A distribution is thus a mapping T : S —> C satisfying 
{T, c<j>) = c {T, fi), 

(T, fi l +fi 2 ) = (T, fii) + (T, fi 2 ), 

where fi, (j>\ and fi 2 are elements of S and c e C. 

One uses the notation (T, fi) to prevent confusion with functions. For the same 
reason it is customary in distribution theory to denote elements in S with the Greek 
symbols fi, fi, etc. In section 8.2.3 we will see that many functions can be consid¬ 
ered as distributions; it would then be very confusing to use the symbols /, g, etc. 
for elements in S as well. Although a distribution T is a linear mapping on S, we 
will nevertheless often write T (t) to express the fact that T acts on functions that 
depend on the variable t. 


8.2.2 The delta function 


Of course, our first example of a distribution should be the delta function 8(t). In 
section 8.1 we have argued that (8.4) is the crucial ‘property’ of 8(t ): to a function 
fi(t) the value fi{ 0) is assigned. This will be taken as the definition of the delta 
function. 

The delta function 8{t) (or 8 for short) is the distribution defined by 
(8(t),fi) = fi( 0) forfieS. 

Fet us verify that 8 is indeed a distribution. It is clear that 8 is a mapping from S 
to C since fi (0) e C. One also has 

(<5, cfi) = (c0)(0) = c • fi( 0) = c (8, fi) 

and 


(8, fi\ + fi 2 ) = (fi\ + fi 2 )( 0) = fi\ (0) + 0 2 (O) = <5, 0i> + (8. fi 2 ). 


which proves the linearity of <5. The delta function is thus indeed a distribution. In 
many books (5, fi) = fi( 0) is written as 



8(t)fi(t)dt = 0(0), 


(8.9) 


just as we have done in (8.4) in connection with (8.2). Relation (8.9) is often called 
the sifting property of the delta function; the value of fi at the point 0 is ‘sifted 
out" by 8. The graphical representation of the delta function in figure 8.2 is also 
based on this property: we draw an arrow at the point 0 of height 1. If we agree 
that the integral in (8.9) is a symbolic representation, then there is no objection. 
Of course, one cannot prove results about the delta function by applying properties 
from integral calculus to this integral. This is because it is only a symbolic way 
of writing. However, calculating in an informal way with the integral (8.9) may 
provide conjectures about possible results for the delta function. As an example one 
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Dirac delta function 


Delta function at a 


General ized functions 


can get an impression of the derivative of the delta function by using integration by 
parts (see example 8.8). 

The delta function was introduced explicitly for the first time by the English 
physicist P.A.M. Dirac in 1926. He was certainly not the first, nor the only one, 
to have some notion of a delta function. The classical result (8.2) for example, is 
already very close to how the delta function operates. Dirac was the first, however, 
to give an explicit meaning to the delta function and to introduce a separate notation 
for it. For this reason the delta function is often called the Dirac function or Dirac 
delta function. In the years following the introduction of the delta function, its use 
produced many results, which in physical practice turned out to be correct. Not until 
1946 was a rigorous distribution theory developed by the French mathematician 
L. Schwartz. 

A slightly more general delta function is obtained by assigning to a function 
0 e S not the value 0(0), but the value 0 (a), where a e Ris fixed. This distribution 
is denoted by 8{t — a), so 


(S(t - a), 0) = 0(a). 


( 8 . 10 ) 


We will call S(t — a) the delta function at the point a. If we choose 0 for the point 
a, then we simply call this the delta function. Symbolically (8.10) is sometimes 
written as 



8{t — a)<p(t) dt — <f>(a). 


( 8 . 11 ) 


We represent the distribution S(t — a) graphically by an arrow of height 1 at the 
point a. See figure 8.2. 



FIGURE 8.2 

The delta function at 0 and at a. 

At the start of this section it was noted that in order to define a distribution it is 
not always necessary to confine ourselves to the space S. The definition of S(t — a) 
for example, and in particular of <5, is also meaningful for any continuous function 
0. Hence, definition 8.2 and (8.10) are often given for all continuous functions 0. 


8.2.3 Functions as distributions 

Distributions are often called generalized filiations because they form an extension 
of the concept of ‘function’. Just as any real number can be considered as a complex 
number, a function apparently can be considered as a distribution. This comparison 
with R as a subset of C is not entirely correct, since not all functions can be consid¬ 
ered as distributions. If, however, the function f(t) is absolutely integrable, then it 


Function as distribution 
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DEFINITION 8.3 
Equality of distributions 


EXAMPLE 8.1 
The function f(t) = 1 


EXAMPLE 8.2 
Unit step function 


can certainly be considered as a distribution Tt by defining 



f(t)4>(t)dt 


for <p € S. 


( 8 . 12 ) 


First, it has to be shown that the integral in (8.12) exists. But for 0 e S one has in 
particular that 0(0 is bounded on R, say | 0(0 | < M. It then follows that 



f(t)cj>{t)dt 


< 



\f{tmt)\dt<M 



I fit) I dt. 


and since / is absolutely integrable. the integral exists. Next we have to show that 
T' r is indeed a distribution. For each 0 e S the integral in (8.12) gives a complex 
number. Hence, Tf is a mapping from S to C. The linearity of Tr follows imme¬ 
diately front the linearity of integration (see also, for example, section 6.4.1) and so 
Tf is indeed a distribution. In this way one can consider any absolutely integrable 
function / as a distribution. But now a problem arises. How do we know for sure 
that two different functions / and g also lead to two different distributions Tf and 
Tgl This ought to be true if we consider distributions as an extension of functions. 
(Two real numbers that are unequal will also be unequal when considered as com¬ 
plex numbers.) But what do we actually mean by ‘unequal' or ‘equal" distributions? 


Two distributions T\ and T 2 are called equal if {T \, 0) = [Ts, 0) for all <j> e S. In 
this case we write T\ = T 2 . 


We now mention without proof that Tf = Tg implies that / = g at the points 
where both / and g are continuous. When no confusion is possible, the distribution 
Tf is simply denoted by /. It is then customary to use the phrase ' f as distribution'. 

We close this section with some examples of distributions that will often return. 
Among other things, these examples will show that many functions which are not 
absolutely integrable still define a distribution Tf through (8.12). 

The constant function f(t) = 1 is not absolutely integrable overR. Still it defines 
precisely as in (8.12) a distribution, simply denoted by 1: 

/ oo 

<p(t)dt for cp e S. (8.13) 

-00 


Since 0 e S, there exists a constant M such that (1 + f 2 ) | 0(0 \ < M. Then the 
integral in (8.13) exists since 


s: 


0(0 dt 


/ oo roo 1 

10(0 \dt <M - - 

-00 2—00 1 + 1 


dt < 00 . 


It is now rather easy to show that 1 is indeed a distribution (that is, a linear mapping 
from S to C). In chapter 9 it will turn out that 1 is the spectrum of the delta function. 
This has been already been made plausible in section 8.1. ^ 


The unit step function e{t) (see example 6.1) defines a distribution, again denoted 
by e(0, or 6 for short, by 

/ OO fOO 

eit)4>(t) dt — / <p(t)dt for 0e5. 

-00 Jo 

Note that (8.12) is again applied here. Further details are almost the same as in 
example 8.1. ^ 
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EXAMPLE 8.3 
Sign function 


EXAMPLE 8.4 

The function f(t) = \ t \ 


EXAMPLE 8.5 


Principal value I /1 


The sign function sgn t is defined by 

I I for t > 0, 

0 for t = 0, 

— 1 for t < 0. 

This function defines a distribution sgn t by 

/ oo roo 

sgn tij>(t)dt= / (<p(t) — <p(—t)) dt for <peS. 

-oo J0 

Here (8.12) is again applied. Further details are the same as in the previous two 
examples. ^ 

The function /(f) = 1 1 | also defines a distribution using (8.12), and again it will 
simply be denoted by 1 1 \: 

/ OO rOO 

\t\<j>{t)dt = / f(0(f) + 0(—f)) dt for feS. 

-oo Jo 

In order to show that the integral exists, we use in this case that there exists a constant 
M > 0 such that 1 1 (1 + f 2 )0(O | < M on R. From here on. the proof is exactly the 
same as in example 8.1. ^ 


The function 1/f is not absolutely integrable on R and even 0(f)/f with 0 e S 
may not be absolutely integrable on R since the point t = 0 may cause a problem. 
Hence, for 1/f we cannot use (8.12) to define a distribution. This problem can be 
solved by resorting to a variant of the Cauchy principal value from definition 7.1. 
Loosely speaking, in this case we let the limits at f = 0 tend to zero at the same 
rate; the distribution arising in this way is denoted by pv(l/f) (pv from ‘principal 
value’). The precise definition of the distribution pv(l/f) is as follows: 


pv0) = 


= lirn f 

a 4.0/1 ; 


<p(t) 


If l>« 


dt = lim 

Qf^O 


f 

Ja 



(8.14) 


for <f> e S. The existence of the right-hand side is again the most difficult step 
in proving that pv(l/f) is a distribution. To this end we split the integral in the 
right-hand side of (8.14) as follows: 


[ ™dt + f 

■f(*<|f|<l 1 4|f|>l 


<P(t) 


dt. 


(8.15) 


First look at the second integral in (8.15). Since | 1/f | < 1 for | f [ > 1, it follows 
that 





/ OO 

\<p(t)\dt, 

-00 


and in example 8.1 it was shown that the last integral exists for <p e S. Hence, the 
second integral in (8.15) exists. For the first integral in (8.15) we note that for any 
a > 0 one has 


f m d t=i 1 *v>dt + r 

Ja<\t\<l 1 Ja i J— 1 


0 ( 0 ) 


dt = 0, 


since 1/f is an odd function. Hence, 


[ m dt= f 

Ja<\r\<l 1 Ja<\t\<l 


0(f)-0(0) 


dt. 
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8.2 


8.3 

8.4 

8.5 

8.6 
8.7 


8.9 


8.10 


Now define 0(f) = (0(f) — 0(O))/f for ( ^ 0 and 0(0) = 000). Then 0 is 
continuous at the point t = 0 since 

0(f)-0(0) , 

lim 0(f) = lim - = 000) = 0(0). 

r^0 f—>0 f — 0 


It then follows that 

0(0 

a<|f|<l t 


lim [ 

aloJa 


dt = lim 


im f 

40 J OL 


0(0 - 0 ( 0 ) 


dt = lim 


c>40 Jof<| 1 1<1 


im f 

00 Joe 


ff<l 1 1<1 


0(f) rff. 


Since 0 is continuous at r = 0, the limit a -» 0 exists and it follows that 


lim f < ! > —-dt= f f{t)dt. 

<*4.0da<|/|<l t 7-1 

Since 0 is a continuous function on the closed and bounded interval [— 1, 1 ], it then 
follows that this final integral, and so the right-hand side of (8.14), exists. ^ 


EXERCISES 

Let 8{t — a) be defined as in (8.10). 

a Show that S(t — a) is a distribution, that is, a linear mapping from S to C. 
b Derive the symbolic notation (8.11) by interchanging the limit and the integral 
in (8.1) (hint: also use that 8(—t) = 5(f), which is quite plausible on the basis of 
(8.3) or (8.8), and which will be proven in section 8.4). 

Show that Tf as defined in (8.12) is a linear mapping. 

Show that 1 as defined in (8.13) is indeed a distribution. 

Prove that the integral in example 8.2 exists and check that e is a distribution. 

Do the same as in exercise 8.5 for the distribution sgnf from example 8.3. 

Prove that | f | from example 8.4 defines a distribution. 

For fixed a e R we define T by ( T , 0) = 00a) for 0 e S. Show that T is a 
distribution. 

Let the function /(f) = | f | -1 / 2 be given. 

a Show that / is integrable on the interval [—1, 1], Is / integrable onR? 
b Show that / defines a distribution by means of (8.12). In particular it has to be 
shown that the defining integral exists (hint: for | f | > 1 one has | f p 1 / 2 < 1). 

Prove for the following functions that (8.12) defines a distribution: 

a /(f) = f, 

b f{t) = f 2 . 


8.3 Derivatives of distributions 

Switching on a (direct current) apparatus at time f = 0 can be described using the 
unit step function e(f). This, however, is an ideal description which will not occur 
in reality of course. More likely there will be a very strong increase in a very short 
time interval. Let u(t) be the function describing the switching on in a realistic way. 
The ideal function e(f) and a typical “realistic" function u(t) are drawn in figure 8.3. 
We assume for the moment that u(t) is differentiable and that u(t) increases from 
the value 0 to the value 1 in the time interval 0 < t < a. The derivative u'ft) of 
u{t) equals 0 for f < 0 and t > a, while between f = 0 and f = a the function 
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—6 - 1 -► 

0 a t 



FIGURE 8.3 

The ideal e(f), the realistic u(t) and the derivative u'(t). 


u'(t ) quickly reaches its maximum and then decreases to 0 rapidly. The graph of a 
typical u'(t) is also drawn in figure 8.3. If we now take the limit a j, 0, then u(t) 
will transform into the function e(t), while u'(t) seems to tend towards the delta 
function. This is because u(t) will have to increase faster and faster over an ever 
smaller interval; the derivative will then attain ever increasing values in the vicinity 
of t = 0. In the limit a ! 0 an object will emerge which is 0 everywhere, except at 
the point t = 0, where the value becomes infinitely large. Since, moreover, 

/ oo ra 

u'(t)dt = / u'(t)dt = [mCOJq = 1 
-oo Jo 

for every a > 0, (8.5) is valid as well. We thus obtain an object fitting precisely 
the description of the delta function from section 8.1. Hence, it is plausible that the 
derivative of e(t) will be the delta function. 
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DEFINITION 8.4 

Derivative of distributions 


Derivative ofe(t ) 


In order to justify these conclusions mathematically, we should first find a def¬ 
inition for the derivative of a distribution. Of course, this definition should agree 
with the usual derivative of a function, since distributions are an extension of func¬ 
tions. Now let / be an absolutely integrable function with continuous derivative f' 
being absolutely integrable as well. Then f defines a distribution Tf and from an 
integration by parts it then follows for tp e S that 

/ OO rOO 

f\t)4>{t ) dt = [/(O0(O]-oo - / dt. 

-oo J —OO 

Since tp e 5, one has lim^-too tp(t) = 0 (for | tp{t) \ < M/( 1 + t 2 )). Moreover, 
the final integral can be considered as the distribution Tt applied to the function 
tp'(t). We thus have 

(T r ,<p) = -(T f ,<p'). (8.16) 

There is now only one possible definition for the derivative of a distribution. 

The derivative T’ of a distribution T is defined by 
(T\4>)=-(T,4>') for tp e S. 

Note that [T, tp'} will certainly make sense because T is a distribution and tp' e S 
whenever tp e S. From the linearity of T and of differentiation the linearity of T' 
immediately follows; hence, T' is indeed a distribution. This means in particular that 
T' has a derivative as well. As for functions this is called the second derivative of 
T and it is denoted by T". Applying definition 8.4 twice, it follows that (T", tp ) = 
(r, tp"). This process can be repeated over and over again, so that we reach the 
remarkable conclusion that a distribution can be differentiated an arbitrary number 
of times. Applying definition 8.4 k times, it follows that the £th derivative T® of a 
distribution T is given by 

lT^\tp\ = (-l) k lT,(p m \ for tpeS. (8.17) 

In particular it follows that any absolutely integrable function, considered as a dis¬ 
tribution, is arbitrarily often differentiable. This gives us an obvious way to find 
new distributions. Start with a function / and consider it as a distribution Tf (if 
possible). Differentiating several times if necessary, one will in general obtain a 
distribution which no longer corresponds to a function. In the introduction to this 
section we have in fact already seen a crucial example of this process. For we have 
argued there that the derivative of the unit step function e(t) should be the delta 
function. This can now be proven using definition 8.4. For according to definition 
8.4 the distribution e' is given by 

/•OO 

[e\ tp) = (e, <P') = - <p\t ) dt = — [0(r)]g°, 

J 0 

where in the second step we used the definition of 6 (see example 8.2). For tp e S 
one has limf-s.±oo <P(t ) =0 and so it follows that 

(e\<p) = <p(0) = (8,tp) for tp e S. (8.18) 

According to definition 8.3 we then have e' — S. The informal derivation in the 
introduction to this section has now been made mathematically sound. 

In order to handle distributions more easily, it is convenient to be able to multiply 
them by a constant and to add them. The definitions are as follows. 



200 


8 Distributions 


DEFINITION 8.5 


EXAMPLE 8.6 


Let S and T be distributions. Then cT (c 6 C) and S + T are defined by 
(cT , <p) = c {T , <p) forcpeS, 

(S + T,4>) = (S,<P) + (T,4>) forfteS. 

The distribution c8{t — a) is given by {c8(t — a), <p) = ctp(a). For c e R 
this is graphically represented by an arrow of height c at the point t = a. See 
figure 8.4. ^ 



FIGURE 8.4 

The distribution c8(t — a). 


EXAMPLE 8.7 


EXAMPLE 8.8 
Derivative of 8(t ) 


The distribution 2 e(t) + 3 iS(t) is given by 

poo 

(2e(f) + 315(f), <p) = 2 <p(t)dt + 3/0(0) for<p e 5. 


We close this section by determining some derivatives of distributions. 


We have just shown that e' = 8, considered as distribution. Differentiating again, 
we obtain that e" = 8'. Just as for 8, there is a simple description for the distribution 
8 ': 

(5', 0) = — (5, 0') = —0'( 0) forces. (8.19) 

Hence, the distribution 8' assigns the complex number —<p'( 0) to a function <p. Note 
also that 8' is still well-defined when applied to continuously differentiable functions 
<p. Symbolically one writes (8.19) as 



S’(t)<p(t)dt = -<p'{ 0). 


( 8 . 20 ) 


This expression can be derived symbolically from (8.9) by taking the function tp' 
instead of <p in (8.9) and performing a formal integration by parts. This example can 
be extended even further by repeated differentiation. Then the distributions 8", 8^\ 
etc. will arise. — 


Let / be a function with continuous derivative f' and assume that both / and 
f' can be considered as a distribution through (8.12). The distribution Tf then has 
the distribution (Tf)' as derivative; if our definitions have been put together well, 
then (T f)' = 70 should be true. For then the two concepts of ‘derivative’ coincide. 
Using (8.16) the proof reads as follows: (Tf, (p) = —[Tf , cp 1 ) = ((Tf)' , tp) for all 
<p e S. When no confusion is possible, one often simply writes f', when actually 
T'f is meant. Most often we then use the phrase f as distribution. 





8.3 Derivatives of distributions 


201 


EXAMPLE 8.9 


EXAMPLE 8.10 


Jump-formula 


The distribution 1 1 | has the distribution sgn t as its derivative (see examples 8.3 and 
8.4): 

/•OO rO 

(\t\',4>) — — [\t \, <t>') = — / t<pft) dt + / tf' (t) dt 
JO J —oo 

/•oo nO 

= - M(0]§° + im)t oo + / 0(0 * - 4>a ) ^ 

Jo J-oo 

= (sgnr, </>) for 4> e 5. 

Here we have used integration by parts and the fact that lim^-too t<p(t) = 0 (since 
<t> e 5). ^ 

Consider the function g(f) = e(f) cos t. Since | cos t \ < 1, one proves precisely as 
in example 8.2 that g(t) defines a distribution. Note that g is not continuous at the 
point t = 0, since there is a jump of magnitude 1 at this point. We determine the 
derivative of g as distribution: 


((e(f) cos tf, <p) 


/•oo 

(e(f)cosr, <p') = - / cos t tjf {t)dt 

Jo 


From an integration by parts and the fact that f e S it follows 

/•oo roo 

[— 4>(t) cos r]S° — / sinr cf>(t) dt = 0 (0) — / e(t)sint 
JO J—oo 

= {8, (j>) — (e(t) sint, <j>) . 

From definition 8.5 (and definition 8.3) it then follows that 
(e(f)cosf/ = 8(t) — €(t)s'mt. 


for <p € S. 
that this equals 
f(t) dt 


This identity is graphically represented in figure 8.5. ^ 

We now derive a general rule having the result e' = 8, as well as the examples 
8.9 and 8.10. as special cases. Let / be a function, continuously differentiable on R, 
except at one point a where / has a finite jump. By f we will mean the derivative of 
/ except at this point a. Assume that both / and f define distributions Tf and Tp 
by means of (8.12). This situation occurs for instance in the examples mentioned 
above. One then has for any ip e S that 


( . /* oo na p oo 

T f'*) = - fm'(t)dt = - fm'(t)dt- fm'iodt, 

1 J—oo J—o o Ja 

and from an integration by parts we then obtain 

It'<p) = -[/(O0(O]_ oo + r f\tmt)dt 

' 1 J—oo 


-v mm 


\a+ f 

Ja 


fm(t)dt 


= -f(a-)4>(a) + f{a+)4>(a) + f f(t)4>(t)dt 

J — OO 

= (/(«+) - /(a-)) ( 8 (t - a), f) + (: T f ,,</>). 

This proves the following jump-formula: 


T’ f = T f , + (/(a+) - /(«-)) «5(f - a). 


(8.21) 
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FIGURE 8.5 

The function e(t) cos t and its derivative, considered as distribution. 


If we take for / the function e(t), then a = 0 and e(0+) — e(0—) = 1. Moreover, 
e'(t) = 0 for t ^ 0, so Tri = 0. It then follows from (8.21) that e' = <5, considered 
as distribution, in accordance with previous results. In a similar way one obtains 
examples 8.9 and 8.10 from (8.21). 

EXERCISES 

8.11 Let T' be defined as in definition 8.4. Show that T' is a linear mapping from S to 

C. 

8.12 a Which complex number is assigned to (j> e S by the distribution 2 8{t) — 

iV3«'(f) + (l + *)sgnf? 

b Show that the function /(f) = at~ + bt + c with a, b and c e C defines a 
distribution through (8.12). 

8.13 a Show that for distributions S and T onehas(5+r)' = S' + T' and (cT)' = cT'. 
Hence, differentiation of distributions is linear. 

b Show that for the constant function /(f) = c one has f' = 0 as distribution. 

8.14 a Which complex number is assigned to / e S by the distribution 8^7 
b To which set of functions can one extend the definition of 5^? 

8.15 a Calculate the derivative of the distribution sgn t in a direct way, using the defi¬ 
nition of the derivative of a distribution. 
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b Verify that sgnf = 2e(t) — 1 for all t 0 and then use exercise 8.13 to deter¬ 
mine the derivative of sgn t again, 
c Determine the second derivative of 1 1 \. 

8.16 Show how examples 8.9 and 8.10 arise as special cases of the jump-formula (8.21). 

8.17 Determine the derivative of the following distributions: 
a Paif), 

b e(f)sinf. 

8.18 The (discontinuous) function /(f) is given by 

I t + 1 for t < 1, 

n for f = 1, 

f 2 — 2f + 5 for t > 1. 

a Verify that /(f) defines a distribution by means of (8.21) (also see exercises 8.10 
and 8.12b). 

b Determine the derivative of /(f) as distribution. 

8.19 Let a < 0 be fixed and consider /(f) = e(t)e al . Prove that f'(t) — af(t) = 5(f) 

(considered as distributions). 

8.20 Define for fixed a 6 1 (a / 0) the function g(t) by g(t) = e(t)(sinat)/a. Prove 

that g"(t) + a 2 g(t) = 5(f) (considered as distributions). 


8.4 Multiplication and scaling of distributions 

In the previous section it was shown that distributions can be added and multiplied 
by a complex constant. We start this section with a treatment of the multiplication of 
distributions. Multiplication is important in connection with convolution theorems 
for the Fourier transform. This is because the convolution product changes into an 
ordinary product under the Fourier transform. If we want to formulate similar results 
for distributions, then we ought to be able to multiply distributions. However, in 
general this is not possible (in contrast to functions). The function /(f) = | f | -1 ' , 
for example, is integrable on, say, the interval [—1, 1] and thus it defines a distri¬ 
bution through (8.12) (see exercise 8.9). But f~(t) = 1/ | f | is not integrable on 
an interval containing 0; hence, one cannot define a distribution using (8.12). Still, 
multiplication is possible in a very limited way: distributions can be multiplied by 
polynomials. As a preparation we will first prove the following theorem. 

THEOREM 8.1 Let (j> € S and p be a polynomial. Then p<f> e S. 

Proof 

A polynomial pit) is of the form a n t n + fl„_if' ,_1 + • • • + a\t + a o with aj e C. If 
4> e S, then certainly c<f> e S for c e C. The sum of two elements in S also belongs 
to S. Hence, it is sufficient to show that t k (p(t) e S for <j> & S and k e N. But this 
has already been observed in section 6.5 (following theorem 6.11). g 

We can now define the product of a distribution and a polynomial. 

Let T be a distribution and p a polynomial. The distribution pT is defined by 


DEFINITION 8.6 
Product of distribution and 
polynomial 


(pT, t) = (T, p4>) fori/teS. 


( 8 . 22 ) 
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EXAMPLE 8.11 


Product of 8 and a 
continuous function 


Theorem 8.1 shows that the right-hand side of (8.22) is meaningful, since T is a 
distribution and p0 € S. Since T is linear, it immediately follows that pT is linear 
as well: 

(pT, c<p) = {T, p(c0)) = (T, c(p0 )) = c (T , p<p) = c (pT, 0) 
and 

( pT , + 02) = <r, p(0i + 02)) = (T, p0i + p0 2 ) 

= {T, P01> + (r, p0 2 ) = (p7\ 0!) + (p7\ 02 > . 

This proves that pT is indeed a distribution. 

For a polynomial p one has 
p(t)8(t) = p(0)5(f). 

This is because according to dehnitions 8.6 and 8.2 we have (p<5, 0) = (<5, p0) = 
(p0)(0) = P(O)0(O) for any 0 e 5. But p(0)0(0) = p(0) (5, 0) = (p(0)<5, 0) 
and according to definition 8.3 the distributions p<5 and p(0)S are thus equal. In 
particular we have for p(t) — t: 

t8(t) = 0. 

Similarly one has for the delta function 8{t — a) that 
p(t)8(t — a) = p(a)S(t — a). 

◄ 

Often a distribution can be multiplied by many more functions than just the poly¬ 
nomials. As an example we again look at the delta function 8(t), which can be 
defined on the set of all continuous functions (see section 8.2.2). Now if / is a 
continuous function, then precisely as in (8.22) one can define the product fS by 

(f8, 0) = (8, /0), 

where 0 is an arbitrary continuous function. From the definition of <5(0 it follows 
that </<5, 0) = y(0)0(0) = /(0) (5, 0) and so one has 

mm = /((wo 

for any continuous function /(f). For the general delta function 8{t — a) it follows 
analogously for any continuous function /(f) that 

f(t)8(t — a) — f(a)8(t — a) for ael. (8.23) 

Similarly one can, for example, multiply the distribution S' by continuously differ¬ 
entiable functions. 

The reason why we are constantly working with the space S lies in the fact that 
S is very suitable for Fourier analysis. Moreover, it can be quite tedious to find 
out exactly for which set of functions the definition of a distribution still makes 
sense. And finally, it would be very annoying to keep track of all these different 
sets of functions (the continuous functions for 5, the continuously differentiable 
functions for 8', etc.). We have made an exception for (8.23) since it is widely used 
in practical applications and also because in much of the literature the delta function 
is introduced using continuous functions. 

We close this section with a treatment of the scaling of distributions. As in the 
case of the definition of the derivative of a distribution, we first take a look at the 
situation for an absolutely integrable function fit). For a el with a /0 one has 
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DEFINITION 8.7 

Seal ing of distributions 


EXAMPLE 8.12 


Time reversal of distribution 


Even and odd distribution 


8.21 

8.22 

8.23 


8.24 

8.25 

8.26 

8.27 


for the scaled function fiat) that 

/ OO rOO 

f(at)cf>(t) dt = | a | _1 / f (z)<p(a~^ t) dr for/eS. 

-oo 7—00 

This follows by changing to the variable r = at, where for a < 0 we should pay 
attention to the fact that the limits of integration are interchanged; this explains the 
factor | a |“ 1 . If we consider this result as an identity for the distributions associated 
with the functions, then it is clear how scaling of distributions should be defined. 

Let T be a distribution and a e R with a / 0. Then the scaled distribution T (at) is 
defined by 

(T (at), cj>(t)) = \a\~ l ^T(t),(p(a~ l t^ forfieS. (8.24) 

According to definitions 8.7 and 8.2 one has for the scaled delta distribution 8(at): 
(S(at),4>(t)) = \a I” 1 (6(f), 0(a-'i))= \a I” 1 <P(0) = I a I -1 (S(t),fi(t)) 
for any / e S. Hence, 

S(at) = \a | _1 8(t). 

A special case of scaling occurs for a — — 1 and is called time reversal. For 
the delta function one has 8(—t) = 8(t), which means that the delta function re¬ 
mains unchanged under time reversal. We recall that a function is called even when 
f(—t) = f(t) and odd when f(—t) — —f(t). Even and odd distributions are 
defined in the same way. A distribution T is called even when T(—t) = T(t) and 
odd when T(—t) = —T(t). The delta function 8(t) is thus an example of an even 
distribution. 

EXERCISES 

In example 8.10 it was shown that (e(t) cos t)' = 8(t) — e(t) sinf. Derive this result 
again by formally applying the product rule for differentiation to the product of e(t) 
and cos t. (Of course, a product rule for differentiation of distributions cannot exist, 
since in general the product of distributions does not exist.) 

Show that for the delta function 8(t — a) one has p(t)8(t — a) = p(a)8(t — a), 
where pit) is a polynomial and (tel. 

The derivative 8' of the delta function can be defined by [8', /) = —<p'( 0) for the set 
of all continuously differentiable functions /. Let /(f) be a continuously differen¬ 
tiable function. 

a Give the definition of the product f(t)8'(t). 
b Show that f(t)8'(t) = f(0)8'(t) - f'(0)8(t). 
c Prove that t8'(t) = —8(t) and that t~8'(t) = 0. 

Show that for the scaled derivative of the delta function one has 8'(at) — 
a -1 | a | -i 8'(t) for a 0. 

Show that the product t ■ pv(l/f) is equal to the distribution 1. 

Show that a distribution is even if and only if one has ( T , /(f)) = (T, /(—f)) for 
all / e 5, while T is odd if and only if (T, (pit)) = — (T, <p(—t)). 

a Show that the distributions sgn f and pv(l/f) are odd. 
b Show that the distribution | f | is even. 
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SUMMARY 

Distributions are linear mappings from the space of rapidly decreasing functions S 
to C. The delta function 8(t — a), for example, assigns the number 0(a) to any 
0 e S (a e R). Many ordinary functions / can be considered as distribution by 

/ oo 

/(00(f) dt for 0 e S. 

-oo 

Examples of this are the constant function 1, the unit step function e(t), the sign 
function sgn 1 and any absolutely integrable function. Like the delta function, the 
distribution pv(l/f) is not of this form. 

Distributions are arbitrarily often differentiable. The delta function is the deriva¬ 
tive of the unit step function. More generally, one has the following. Let / be a 
function with a jump of magnitude c at the point t = a. Then the derivative of / (as 
distribution) contains the distribution c8(t — a) at the point / = a. 

Distributions can simply be added and multiplied by a constant. In general they 
cannot be multiplied together. It is possible to multiply a distribution by a polyno¬ 
mial. Sometimes a distribution can also be multiplied by more general functions. 
For example, for the delta function one has f(t)8(t — a) = f(a)8(t — a) (a e R) 
for any continuous function /(f). Finally, one can scale distributions with a real 
constant a ^ 0. For a = — 1 this is called time reversal. This also gives rise to the 
notions even and odd distributions. 


SELFTEST 


8.28 


8.29 


8.30 


Given is the function /(f ) = In | f | for f ^ 0. 

a Show that 0 < In f < f for f > 1 and conclude that 0 < In | f | < | f | for 

\t\ > 1 - 

b Show that / is integrable over [—1, 1], Use part a to show that / defines a 
distribution by means of (8.12). 
c Prove that / defines an even distribution. 


The continuous function /(f) is given by 


f{t) = 


t 2 for f > 0, 
2f for f < 0. 


a Prove that / can be considered as a distribution, 
b Find the derivative of / as distribution, 
c Determine the second derivative of / as distribution. 

Consider the second derivative 8" (t) of the delta function, 
a For which set of functions /(f) can one define the product f(t)8"(t)2 
b Prove that f(t)8"(t) = /"(0)S(f) - 2/'(0)«5'(f) + f(0)8"(t). 
c Show that t 2 8”(t ) = 28(t) and that f 3 5"(f) = 0. 

d Show that for a ^ 0 one has for the scaled distribution 8"(at) that 8"(at) — 
a~ 2 | a | _1 8”(t). 
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CHAPTER 9 


The Fourier transform of distributions 


INTRODUCTION 


In the previous chapter we have seen that distributions form an extension of the fa¬ 
miliar functions. Moreover, in most cases it is not very hard to imagine a distribution 
intuitively as a limit of a sequence of functions. Especially when introducing new 
operations for distributions (such as differentiation), such an intuitive representation 
can be very useful. In section 8.1 we applied this method to make it plausible that 
the Fourier transform of the delta function is the constant function 1, and also that 
the reciprocity property holds in this case. 

The purpose of the present chapter is to develop a rigorous Fourier theory for 
distributions. Of course, the theory has to be set up in such a way that for functions 
we recover our previous results; this is because distributions are an extension of 
functions. This is why we will derive the definition of the Fourier transform of 
a distribution from a property of the Fourier transform of functions in section 9.1. 
Subsequently, we will determine the spectrum of a number of standard distributions. 
Of course, the delta function will be treated first. 

In section 9.2 we concentrate on the properties of the Fourier transform of dis¬ 
tributions. The reciprocity property for distributions is proven. We also treat the 
correspondence between differentiation and multiplication. Finally, we show that 
the shift properties also remain valid for distributions. 

It is quite problematic to give a rigorous definition of the convolution product 
or to state (let alone prove) a convolution theorem. Fet us recall that the Fourier 
transform turns the convolution product into an ordinary multiplication (see section 
6.6). But in general one cannot multiply two distributions, and so the convolution 
product of two distributions will not exist in general. In order to study this problem, 
we start in section 9.3 with an intuitive version of the convolution product of the 
delta function (and derivatives of the delta function) with an arbitrary distribution. 
We then look at the case where the distributions are defined by functions. This 
will tell us in which situations the convolution product of two distributions exists. 
Finally, the convolution theorem for distributions is formulated. The proof of this 
theorem will not be given; it would lead us too far into the theory of distributions. 

FEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know and can apply the definition of the Fourier transform of a distribution 

- know the Fourier transform of the delta function and the principal value l/t 

- can determine the Fourier transform of periodic signals and periodic signals that 
are switched on 

- know and can apply the properties of the Fourier transform of distributions 

- know and can apply the convolution product and the convolution theorem for dis¬ 
tributions in simple cases 

- know the comb distribution and its Fourier transform*. 
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9.1 The Fourier transform of distributions: definition and examples 

It should come as no surprise that we will start section 9.1.1 with the definition of the 
Fourier transform of a distribution. In section 9.1.2 we then determine the Fourier 
transform of a number of standard distributions. We also discuss how the Fourier 
transform of periodic signals (considered as distributions) can be determined. Fi¬ 
nally, we treat the so-called comb distribution and its Fourier transform in section 
9.1.3. 


9.1.1 Definition of the Fourier transform of distributions 

In section 8.1 we sketched an intuitive method to obtain the Fourier transform of a 
distribution. First, a distribution is considered symbolically as a limit of functions 
f a whose Fourier transforms F a are known. Next, the limit of these functions F a 
is determined. So when the distribution T is given by T = lim f a (for a —> oo for 
example) and f a -o- F a , then the Fourier transform of T is given by TT = lim F a 
(for a —y oo). Mathematically, however, this method has some serious problems. 
What is meant by the symbolic limits T = lim f a and TT = lim F a ? Is the choice 
of the sequence of functions f a (and hence F a ) uniquely determined? And if not, is 
TT uniquely determined then? One can solve all of these problems at once using 
the rigorous definition of distributions given in the previous chapter. The only thing 
still missing is the rigorous definition of the Fourier transform - or spectrum - of a 
distribution. Of course, such a definition has to be in agreement with our earlier def¬ 
inition of the Fourier transform of a function, since distributions form an extension 
of functions. Precisely as in the case of the definition of the derivative of a distribu¬ 
tion, we therefore start with a function / that can be considered as a distribution Tf 
according to (8.12). Is it then possible, using the properties of the Fourier transform 
of ordinary functions, to come up with a definition of the Fourier transform of the 
distribution Tf ? Well, according to the selfduality property in section 6.4.7 one has 
for any f e S 

/ oo poo 

F(t)<p(t) dt = I fumodt, 

-oo d—oo 


DEFINITION 9.1 

Fourier transform or 
spectrum of distributions 


where $ is the spectrum of f and F is the spectrum of /. From theorem 6.12 it 
follows that e S and so the identity above can also be considered as an identity 
for distributions: {Tp.fi) = (7V, d>). From this, it is obvious how one should define 
the Fourier transform (or spectrum) of an arbitrary distribution. 

For a distribution T the Fourier transform or spectrum TT is defined by 


{TT. f) = {T, *>, 


(9.1) 


where $ is the Fourier transform off e S. 

We recall once again theorem 6.12, which established that $ e S for f e S. 
Hence, the right-hand side of (9.1) is well-defined and from the linearity of T it 
follows immediately that TT is indeed a distribution. The mapping assigning the 
spectrum TT to a distribution T is again called the Fourier transform. In section 

9.1.2 we determine the Fourier transform of a number of distributions. 
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Spectrum of 5(f) 


Spectrum of 1 


9.1.2 Examples of Fourier transforms of distributions 

First of all, we will use definition 9.1 to determine the Fourier transform of the delta 
function. We have 

/ oo 

f(t)dt for (f> e S, 

-oo 

where in the last step we used the definition of the ordinary Fourier transform. From 
example 8.1 it then follows that (J-8, <j>) = (1, <j>), which shows that the spectrum of 
5 is indeed the function 1. A short symbolic proof is obtained by taking e~ ,a>t for <f> 
in (8.9). It then follows that 

/ oo 

S(t)e~ im, dt= 1, (9.2) 

-oo 

which states precisely (but now symbolically) that the spectrum of 5 (f) is the func¬ 
tion 1. Figure 9.1 shows 5(f) and its spectrum. 


i 

L 



k 

5(f) 


0 

t 



FIGURE 9.1 

The delta function 5(f) and its spectrum. 


Conversely, the spectrum of the function 1 is determined as follows: 

/ oo 

<t>(w) dm. 

-oo 


For <j) e S the inversion formula (7.9) certainly holds. Applying it for f = 0, it 
follows that 

/ oo 

<t>{m)dm = 2^(0) = 2tc ( S,cf>) = (2?r5 , <p) fov <p e S. 

-oo 


Hence, the spectrum of the function 1 (as distribution) is given by the distribution 
2nS(m). Symbolically, this is sometimes written as 



dt = 2n8(w). 


(9.3) 
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EXAMPLE 9.1 
Spectrum ofS(t — a) 


Spectrum of e ,at 


EXAMPLE 9.2 


THEOREM 9.1 


(Note that the integral in the left-hand side does not exist as an improper integral; 
see exercise 6.1.) The results that have been derived intuitively in section 8.1 have 
now all been proven. Note that S(t) <b* 1 and 1 <-> 27r 8(co) constitute a Fourier 
pair in the sense of section 7.2.2. In section 9.2.3 we will prove that indeed the 
reciprocity property for distributions remains valid. In the next example the delta 
function at the point a is treated (see (8.10) for its definition). 


The spectrum ofS(t-a) is the function e laa> (considered as distribution of course). 
The proof is similar to the case a — 0: 


{T8(t — a), (/>) = (S(t — a), 4>) = <t>(a) = f fi(t)e~ m 'dt for cpeS. 

J—o o 


If we now call the variable of integration to instead of t, then the result follows: 
(T8(t — a), <p) = (e~' aa> , tpy Conversely, one has that 27tS(a> — a) is the spectrum 
of the function e ' at : 


(. Te ia, ,<t>) = (e iat . $) = 



e ia, <t>(t) dt 


and according to the inversion formula (7.9) it then follows that (Te lat ,tj>) = 
2n<f)(a) = (2n8(to — a), tj>) (tj> e <S), which proves the result. We thus again have a 
Fourier pair 8(t — a) ■*> e~ lam and e' at -o- 2nS(a> — a). Also note that the function 
e lat is a periodic function with period 2n/a. ^ 


Just as for the Fourier transform of functions, the Fourier transform of distribu¬ 
tions is a linear mapping. For distributions S and T and a, b e C one thus has 
T(aS + bT) = aTS + bTT. 


Since the Fourier transform is linear, it follows from example 9.1 that the spectrum 
of cos at — ( e iat + e~' a, )/2 is the distribution jt(S(a> — a) + 8(a> + a)). This is 
represented graphically in figure 9.2. ^ 

For the Fourier transform of distributions one has the following result. 

The Fourier transform is a one-to-one mapping on the space of distributions. 

Proof 

Because of the linearity of the Fourier transform, it is sufficient to show that TT = 0 
implies that T = 0. So let us assume that TT = 0, then ( TT , </>) = 0 for all <f> e S. 
From definition 9.1 it then follows that (T. $) = 0 for all <f> e S. But according to 
theorem 7.6 one can write any e S as the spectrum <t> of some fi e S. Hence, 
(T , fi) = 0 for all e S. which means that T = 0 (definition 8.3). g 

Theorem 9.1 is often used (implicitly) in the following situation. Let a distribu¬ 
tion U be given. Suppose that by using some table, perhaps in combination with the 
properties of the Fourier transform, we have found a distribution whose spectrum 
is the given distribution U. We may then conclude on the basis of theorem 9.1 that 
we have found the only possibility. For a given distribution T there is thus only one 
distribution U which is the spectrum of T. As for functions, T -o- U will mean 
that U is the spectrum of T and that the distributions T and U determine each other 
uniquely. 


EXAMPLE 9.3 


Suppose that we are looking for a distribution T whose spectrum is the distribution 
U = 45(w — 3) — 28(a> + 2). In example 9.1 it was shown that e iat -o- 2n8(a> — a). 
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EXAMPLE 9.4 
Spectrum ofpv(l/1) 



FIGURE 9.2 

The function cosat and its spectrum. 


From the linearity of the Fourier transform it then follows that T — (2/n)e iit — 
(l/n)e~^ it is a distribution with spectrum U. Theorem 9.1 guarantees that it is the 
only one. ^ 

In the next example the spectrum of the distribution pv(l/f) will be determined. 

The spectrum of the distribution pv(l /t) from example 8.5 is the distribution 
—Tti sgntu. A mathematically rigorous proof of this result would lead us too far 
into the theory of distributions. Instead we will only give the following formal proof 
(using a certain assumption, one can give a rigorous proof; see exercise 9.23). 

f 4 >(?) 

(^ r pv(l/t), 4>) = <pv(l/t), $) = lim / - dt for^eS. 

a ~*0 J | r |>a I 

Now apply the definition of spectrum for <t>(t), then 

(JEpv(l/t), f) = lim [ - ( [ (j>{(o)e~ ,m, rfw) dt. 

a ~>0J\t\>a t \J—oo ) 
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Next, we (formally) interchange the order of integration and write the limit inside 
the integral (again formally). We then obtain 




(JTpv(l /t),(p)= [ lim f 

J—oo \a^0j\t\>a t 

The inner integral can easily be calculated since 

roo e —io>t n—a g —imt rc 

/ - dt + - dt = 

Jet t J—oo t Ja 


dt I da>. 


(9.4) 


■ dt = —2 i 


•s 


sin cut 


- dt. 


Here we changed from the variable t to the variable — t in the second integral of the 
left-hand side. Now use that 


C°° sin cut 
/ - dt 

Jo t 


n 

— sgneu. 


For a> > 0 this follows from theorem 4.11 (or from (7.3)) by changing from the 
variable a>t to the variable t , while for u> < 0 an additional minus sign enters because 
the limits of integration will be reversed; for to = 0 we have sin a>t = 0. The limit 
for a —> 0 of the inner integral in (9.4) thus exists and 


f e~ ia>t 

lim / - dt = — 7n'sgna>. 

O'—>0j|f|>Q. t 

From (9.4) (and example 8.3) it then follows for every e S that 

/ oo 

sgn axplai) da> = (—nisgna), cj)(at)) , 

-oo 

which proves that pv(l/f) -o- — 7rtsgna>. This is shown in figure 9.3. Note that 
—ni sgn a> assumes only imaginary values; in figure 9.3 this is emphasized by the 
dashed lines for the corresponding curves. ^ 



-ni sgn co 


FIGURE 9.3 

The distribution pv(l/ 1) and its spectrum. 


Spectrum of periodic 
functions 


We end section 9.1.2 by determining the spectrum of a periodic signal using the 
result (lFe la, ){m) = 2nS(a> — a) (see example 9.1). So let / be a periodic function 
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Comb or shah distribution 


with a converging Fourier series: 

oo oo 

/(f) = J2 c k e 2nikt l T = J2 c k e ikmot , 
k=—oo k=—oo 

where coq = 2 jt/T. Assume, moreover, that / dehnes a distribution by means of 
(8.12). The Fourier series then also defines a distribution and the spectrum of this 
distribution can be calculated as follows: 

( oo \ oo oo 

E c k e ikwo, \= J2 c k T(e ika *> , )=2n £ c k S (co - kco 0 ). (9.5) 

k=—o o / k=—o o A'=—oo 

Here we assumed that the Fourier transform T and the summation may be inter¬ 
changed. We will not prove that this is indeed allowed. 

In fact, (9.5) shows once again that a periodic function /(f) has a line spectrum: 
the spectrum consists of delta functions at the points co = ka>Q (k e Z) with ‘weight’ 
equal to the Ath Fourier coefficient c k (also see section 3.3). 


9.1.3 The comb distribution and its spectrum* 


The material in this section can be omitted without any consequences for the re¬ 
mainder of the book. Furthermore, we note that Poisson's summation formula from 
section 7.3* will be used in an essential way. 

The main reason that we treat the comb distribution is the fact that it is widely 
used in the technical literature to represent the sampling of a continuous-time signal 
(see later on in this section). 

The comb or shah distribution is defined by 

oo 

(<M= E <p(k) for <p e S. (9.6) 

k=—oo 


First we will have to show that is well-defined, that is, the series in the right-hand 
side of (9.6) converges. But for tp e S there exists a constant M > 0 such that 
(1 + t ~) | <p(t ) | < M. Hence, it follows that (compare with example 8.1) 


oo oo 

E \<P(k)\<M J2 

k =—oo k=—o o 


1 

1 +k 2 


OO 

M + 2M^2 

k= 1 


1 

1 +k 2 ' 


But 1 + k 2 > k 2 for k > 0 and k “ converges. Hence, 


OO 

E 

k=—oo 


< i0w i < 

k=—oo 


M | 1+2 Y^ k ~ 2 
k= 1 


< OO. 


It now immediately follows that defines a distribution. Since one has ( 8(t — k), 
(p) = (p(k) (see (8.10)), we obtain from (9.6) that 

oo 

0M= E (w-V’M 

k=—oo 


for every (p e S. Because of this, one often writes ^ as 

oo 

u?(f)= J2 s (t~k) 

k=—oo 
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Train of delta functions 


Sampling 


and calls a train of delta functions. The distribution is then graphically repre¬ 
sented as in figure 9.4a. Often, is used to represent the sampling of a continuous¬ 


ly) 


11111' ; '11111T t 


-5 -4 -3 -2 -1 0 


1 2 3 4 5 6 7 


2n 


®(co/2ji) 


-271 


271 


471 to 


FIGURE 9.4 

The impulse train (a) and its spectrum (b). 

time signal (for example in Van den Enden and Verhoeckx (1987), chapter 3 (in 
Dutch)). For when /(f) is a bounded continuous-time signal, then the product 
/(f)lZTf) exists (we state this without proof) and one has (as in definition 8.6) 

oo oo 

(mm), <t>) = (w), /</>} = E /(*)*(*)= E </(*)*(*-*). *> 

k=—oo k=—o o 

for all 0 € S. Hence we obtain that 

oo 

f(tmt)= E /(*)*(*-*)• 

k=—oo 

The right-hand side of this can indeed be interpreted as the sampling of the function 
/(f) at times t = Ic (k e Z); see figure 9.5. 

After this short intermezzo on sampling, we now determine the spectrum of the 
comb distribution 2?. From the definition of it follows that 

oo 

[T tt?, fi) = (W, $) = E for e S. 

k =—oo 

From example 7.9 it follows that Poisson’s summation formula (7.23) is valid for 
functions in <S. If we apply it with T = 2tt, then it follows that 

oo oo 

</>) = E <D(jfc) = 2?r E 0(2fT7t) = {W(w/2n), <j>) 

k=—oo k=—oo 

for every fi e 5 (in the last step we used the scaling property for distributions 
with scaling factor 1/2 jt; see definition 8.7). We have thus proven that T = 
\l/(cL>/2n), where ]tf(co/2n) is the scaled comb distribution ii’; the spectrum of the 
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FIGURE 9.5 

A continuous-time function /'(f) and the sampling /(f) tt?(f). 


Spectrum of comb distribution is thus again a comb distribution: 

mt) W(w/2jt). (9.7) 

In the notation of the impulse train, (9.7) becomes 

oo oo 

^ 8(t-k)+>2n S(a>-2nk), (9.8) 

k=—oo k=—oo 

and one then expresses this by saying that the spectrum of an impulse train is again 
an impulse train. See figure 9.4b. 

EXERCISES 

9.1 Let T be a distribution. Show that TT as defined by (9.1) is a linear mapping from 

S to C. Conclude that TT is a distribution. 
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9.2 Let S and T be distributions with spectra U and V respectively. Show that for 
a,b e C the spectrum of a5 + bT equals aU + bV. The Fourier transform of 
distributions is thus a linear mapping. 

9.3 Determine the spectrum of the following distributions: 
a S(t — 4), 

b 

c sin of, 

d 4 cos 2? + 2/pv(l/f). 

9.4 Determine the distribution T whose spectrum is the following distributions: 
a S(a> + 5), 

b 2nS(a) + 2) + 2n&(a> — 2), 
c sgn at + 2 cos a>. 

9.5 Show that the spectrum of an even (odd) distribution is again an even (odd) distri¬ 
bution. 

9.6* a Verify that {£? defines a distribution. 

b Define the distribution YlkL-oo e ‘ k0> by 

0° \ OO 

J2 e ikm ,ct>)= J2 («'’*“. *) for <p e S. 
k=—o o / k= —oo 

Show that T W = E£-oo e ' ku> ■ 


9.2 Properties of the Fourier transform 

Most of the properties of the Fourier transform of functions, as derived in section 
6.4, can easily be carried over to distributions. In this section we examine shifting, 
differentiation and reciprocity (in exercise 9.9 scaling is considered as well). 


9.2.1 Shift in time and frequency domains 


DEFINITION 9.2 
Shifted distribution 


First we treat the shifting property in the time domain. We will show that for a 
distribution T with spectrum U one has T(t — a) -o- e~ lam U (in) (a e R), just 
as for functions (see section 6.4.3). Apart from the proof of this property, there 
are two problems that we have to address. Does the product of U (co) and e~ ,ao> 
exist? And what do we mean by the shifted distribution T(t — a)? We start with 
the first problem. The product e~ lam U (a>) can be defined precisely as in (8.22) by 
(e~ lau> Uim). = (u(a>), e~ ,aa) 4(<P G S). This definition makes sense since it 
follows immediately from the product rule for differentiation and from | e~ ia(u | = 1 
that e~ la< °<f) e S. This solves the first problem. We now handle the second problem 
and define the shifted distribution T(t — a). 

For a distribution T(t) the distribution T(t — a) shifted over a e R is defined by 
{T(t-a),<P(t)) = (T(t),4>(t + a)). 

As before (for example, for differentiation, scaling and the Fourier transform), 
this definition is a direct generalization of the situation that occurs if we take T 
equal to a distribution Tf, where / is a function (see (8.12)). 
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EXAMPLE 


Shift property 

EXAMPLE 


Spectrum ofS'ft ) 


Differentiation in time 
domain 


As is suggested by the notation, the delta function S(t — a) at the point a is in¬ 
deed the shifted delta function S(t). This is proven as follows: ( S(t — a), <j>{t)) = 
(<5(f), (j>(t + a)) = <p(a), which is in agreement with the earlier definition of S(t — a) 
in (8.10). " M 

We can now prove the shifting property for distributions. When T(t) is a distri¬ 
bution with spectrum U (co), then 

(F(T(t — a)), <j>{t)) = (T(t — a), <D(f)> = (T(t), <t>(f + a)> for f e S. 

From the shifting property in theorem 6.4 it follows that 
(T(t), <t>(t + a)) = {T(t ), F(e~ ia, <p(t))^ = (u(co), . 

Hence, (. F(T(t — a )), < p(t)) = [e~ law U(co), 4>(co)\, proving that 

T(t -a) e~ iato U(( w). (9.9) 

Since 5(t) -o- 1, it follows from the shifting property that S(t — a) e~ lau> , in 
accordance with example 9.1. ^ 

In a similar way one can prove the shifting property in the frequency domain (see 
exercise 9.15): 

e iat T ^ U(co - a) (9.10) 


9.2.2 Differentiation in time and frequency domains 


For the ordinary Fourier transform, differentiation in one domain corresponded to 
multiplication (by —it or ia>) in the other domain (see sections 6.4.8 and 6.4.9). This 
is also the case for the Fourier transform of distributions. We start by determining 
the spectrum of the derivative S'(t) of the delta function. Successively applying 
definitions 9.1, 8.4 and 8.2, we obtain that 


<)>) = (S', <!>) = — (S. <t>') = -<t>'(0) for feS. 

According to theorem 6.8 one has <J> , (w) = J-(—it4>(t))(a>) and so 


/ oo 

it<f>(t) dt = {it, <p) for <f> 
-oo 


€ S. 


The variable t in the integral - and in the distribution - is irrelevant; by changing to 
the variable co we have thus shown that S' -o- ia>. In general one has for an arbitrary 
distribution T with spectrum U that T' -o- icoU. In fact, as for the spectrum of the 
derivative of the delta function, it follows that 


(FT', f) = (: T', <D) = - (T, 4>') = (T, F(it4>m = (U, itfft)). 

In the last step we use that T -o- U. Again, the variable t is irrelevant and if we 
consider the distribution U as acting on functions in the variable co, then we may 
also write (FT ', <p( = ( U , icoffco)). From definition 8.6 of the multiplication of 
distributions by polynomials, we then finally obtain that (FT', <p) = ( icoU, <p(co)), 
which proves the result. More generally, one has (see exercise 9.8c): 

T (k) (ico) k U when T ** U. (9.11) 
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Differentiation in frequency 
domain 


EXAMPLE 


Similarly, one can prove the differentiation rule in the frequency domain (see 
exercise 9.10c): 

( -it) k T U {k) when T U (9.12) 

(compare with section 6.4.9). This rule is mainly used to determine the spectrum of 
t k T when the spectrum of T is known. 

We know from section 9.1.2 that 1 -o- 2nS(a>). From (9.12) (for k — 1 and k — 2) 
it then follows that t -o- 2jrz<5 , (a>) and t 2 -o- —2nS"(a>). ^ 


Reciprocity 


EXAMPLE 


EXAMPLE 9.6 
Spectrum ofsgn t 


Spectrum of eft ) 


EXAMPLE 9.7 


9.2.3 Reciprocity 

The Fourier pair <5 -o- 1 and 1 -o- 2nS suggests that the reciprocity property also 
holds for distributions. This is indeed the case: if U is the spectrum of T, then 
2nT(a >) is the spectrum of U (— t), or 

(7(-0 2nT(to) (9.13) 

(where U(—t ) is the scaled distribution from definition 8.7 with a = —1). For 
its proof we first recall the reciprocity property for functions: if cj> -o- then 
4>(—f) 2tT(p(a>). Hence, it follows that 

(2nT(w), 0(w)> = ( T(co ), 2ncj>{co)) = {T(co). T(4 >(-f))> = (U(t). <f>(-t)) . 

Formula (9.13) is then proven by applying definition 8.7 of scaling. For then it 
follows for every tp e S that 

(2 ttT(co), 4>(co)) = ( U(-t ), <D(f)> = ifFU (—f), </>(«)). 

For T we take the delta function, so U is the function 1. Since 1 is an even distribu¬ 
tion, it follows front (9.13) that 1 -o- 2nS, in accordance with our previous results 
from section 9.1.2. ^ 

The distribution sgnf is odd (see exercise 8.27a). Applying (9.13) to the result of 
example 9.4, we obtain that the spectrum of nisgnt is the distribution 27rpv(l/a>), 
that is, 

sgnf -o- — 2zpv(l/a>). (9.14) 

Since eft) = (1 + sgn f)/2, where eft) is the unit step function, it follows that 

e(t) -o- nS(a>) — zpv(l/a>), (9.15) 

where we used the linearity of the Fourier transform. The function e(t) and its 
spectrum are shown in figure 9.6; imaginary values are represented by dashed curves 
in this figure. ^ 

We know from (8.18) that e' = S. From (9.11) it then follows that Th = Te' = 
icoiFe. Apparently, iivJ-e = 1. Now we have shown in example 9.6 that Te = 
nS(a>) — zpv(l/&>) and indeed we have ia>(nS(a>) — i pv(l/a>)) = nia)S(co) + 
copv(l/a>) = 0+1 = 1 (see example 8.11 and exercise 8.25). ^ 

At the end of section 9.1.2 we determined the spectrum of periodic functions. One 
can use (9.15) to determine the spectrum of periodic functions that are ‘switched on’. 
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FIGURE 9.6 

The unit step and its spectrum. 


Switched-on periodic signal 


Spectrum of switched-on 
periodic signal 


Let f(t ) be a periodic function with period T and converging Fourier series 


f(f)= £ c k e 2 * ik, l T . 
k=—oo 

We will call e(t)f(t) a switched-on periodic signal. In (9.15) the spectrum of e(t) 
has been determined, and from the shifting property (9.10) it then follows that 

e(t)e iktco ° -o- nS(a> — ka>o) — ipv(l/(a> — ka>o)), 

where oiq = Ttc/T. If we now assume, as in section 9.1.2, that the Fourier transform 
and the summation may be interchanged, then it follows that the spectrum of a 
switched-on periodic signal e(t)f(t) is given by 


Y' c k ( Tt 8 (a) - kto 0 ) - ipv --- ). 

r~L V fo — ka>Q) 


(9.16) 


k=—c o 
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9.7 


9.8 


9.9 


9.10 


9.11 

9.12 


9.13 


9.14 


9.15 

9.16 


9.17 


EXERCISES 

The spectrum of sgnf is —2;pv(l/o>) (see example 9.6). Verify that e(t) = (1 + 
sgnf)/2 (t 7^ 0) and that the spectrum of e(t) is given by n8(a>) — /pv(l/&>) (as was 
stated in example 9.6). 

a Determine in a direct way (without using (9.11)) the spectrum of 8". 
b Let T be a distribution with spectrum U. Show that T" -o- —a> 2 U. 
c Prove (9.11): T (k > (ia>) k U when T U. 

a Let T be a distribution with spectrum U. Show that for a ^ 0 the scaled distri¬ 
bution T(at) has | a | -i U ( co/a ) as its spectrum, 
b Determine the spectrum of 5(4/ + 3). 

a Show that — itT -v> U' when T -o- U. 

b Use part a to determine the spectrum of t8 (/) and fpv( 1//); check your answers 
using example 8.11 and exercise 8.25. 
c Show that (—it) k T <-> t/® when T -o- U. 

Determine the spectrum of t8'(t) and t8"(t ) using (9.12); check your answers using 
exercises 8.23 and 8.30. 

From the identity e' = 8 it follows that (Fe 1 = T8 = 1. The differentiation rule 
(9.11) then leads to icoJ-e — 1. Hence, Tt = 1 /ia>, where we have to consider 
the right-hand side as a distribution, in other words, as pv(l/o>). Thus we obtain 
Ti = — ;pv(l/a>). Considering the result from example 9.6 (or exercise 9.7), this 
cannot be true since the term iz8(co) is missing. Find the error in the reasoning given 
above. 

Let T be a distribution. Define for a e R the product e lat T by [e' a, T,4’>) — 
(t, e ,at (py Show that e la, T is a distribution. 

Let T f be a distribution defined by a function / through (8.12). Show that for this 
case, definition 9.2 of a shifted distribution reduces to a simple change of variables 
in an integral. 

Prove (9.10): e ia, T o U(co - a) when T U. 

Determine the spectra of the following distributions: 
a e(t — 1), 
b e(t)e iat , 
c e(t) cos at, 
d 8\t - 4) + 3(, 
e TT/'f 3 + e(/)sgn/. 

Determine the distribution T whose spectrum is the following distributions: 
a pv(l/(t» - 1)), 
b (sin3a>)pv(l/a>), 

C 6 (to), 

d <5(3&> — 2) + 8"(co). 


9.3 Convolution 

Turning the convolution product into an ordinary multiplication is an important 
property of the Fourier transform of functions (see the convolution theorem in sec¬ 
tion 6.6). In this section we will see to what extent this result remains valid for 
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distributions. We are immediately confronted with a fundamental problem: in gen¬ 
eral we cannot multiply two distributions 5 and T. Hence, the desired property 
T(S * T) = TS ■ TT will not hold for arbitrary distributions S and T. This is 
because the right-hand side of this expression will in general not lead to a meaning¬ 
ful expression. If we wish to stick to the important convolution property, then we 
must conclude that the convolution product of two distributions is not always well- 
defined. Giving a correct definition of convolution is not a simple matter. Hence, 
in section 9.3.1 we first present an intuitive derivation of the most important results 
on convolution. For the remainder of the book it is sufficient to accept these intu¬ 
itive results as being correct. For completeness (and because of the importance of 
convolution) we present in section 9.3.2 a mathematically rigorous definition of the 
convolution of distributions as well as proofs of the intuitive results from section 
9.3.1. Section 9.3.2 can be omitted without any consequences for the remainder of 
the book. 


9.3.1 Intuitive derivation of the convolution of distributions 


As we often did, we first concentrate ourselves on the delta function 5(f). Let us 
return to the intuitive definition of the delta function from section 8.1. If we inter¬ 
change limit and integral in (8.1), then we obtain the symbolic expression 



S(T)f(t-T)dT = f(t). 


(9.17) 


Changing from the variable t — z to r in the integral leads to 



/(r)5(f — x)dx = /(f) 


(9.18) 


(also see the similar formula (8.11) and exercise 8.2. although there we also used that 
S(—t) = 5(f)). If we now pretend that the delta function is an ordinary absolutely 
integrable function, then we recognize in the left-hand sides of (9.17) and (9.18) 
precisely the convolution of 5 and / (see definition 6.4) and so apparently (5 * 
f)(t) = /(f) and (/ * 5)(f) = /(f). This is written as5*/ = /*5 = / for 
short. If we now consider 5 and / as distributions again, then one should have for 
an arbitrary distribution T that 


8*T = T *8 = T. 


(9.19) 


In a similar way one can derive an intuitive result for the convolution of 8' with a 
distribution T. For the delta function 8'(t — a) one has [8'(t — a), (j>) = —<p'(a) for 
each f e S. This can again be symbolically written as 



a)f(x) dr 


-f\a ), 


where, as in (9.17) and (9.18), we now write / instead of <f (fora = 0 this is (8.20)). 
Now 5/r — a) is an odd distribution (see exercise 9.18), so 8'(z — a) — —8'(a — r), 
and if we also write f instead of a, then we see that 



S'(t-T)f(T)dr = f'(t). 


The left-hand side can again be interpreted as the convolution of 5' with / and 
apparently one has (5' * /)(f) = f'(t). By changing from the variable f — r to r it 
also follows that (/ * S')(t) = /'(f). If we consider 8' and / as distributions, then 
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one should have for an arbitrary distribution T that 

S' * T = T * S' = T'. (9.20) 

Analogously, one can derive for the higher order derivatives <5® of the delta function 
that 

<5® * T = T *<5 W = T®. (9.21) 

In section 9.3.2 we will define convolution of distributions in a mathematically rig¬ 
orous way and we will prove formulas (9.19) - (9.21). 

We will close this subsection by showing that the convolution theorem (theorem 
6.13) is valid in the context of formulas (9.19) and (9.20), that is to say, 

T(S *7-) = jr S . jr T atl d jr (S ' * T) _ . jr T (9.22) 

First of all, the first identity in (9.22) follows immediately from 8*T = T and TS = 
1 since T(S * T) = TT = TS ■ TT. To prove the second identity in (9.22) we first 
note that (9.11) implies that TT' = icoTT. But iw — TS 1 (see section 9.2.2) and 
hence it follows from (9.20) that indeed T{S' * T) = TT' = imTT = TS' ■ TT. 
Similarly, one can show that the convolution theorem also holds for higher order 
derivatives of the delta function. Finally, in this manner one can also verify that 
the convolution theorem in the frequency domain, that is, S ■ T -o- (U * V)/2n 
when S ■*»■ U and T ■<-> V. is valid whenever the delta function or a (higher order) 
derivative of the delta function occurs in the convolution product. In section 9.3.2 
we will discuss in some more detail the convolution theorems for distributions and 
we will formulate a general convolution theorem (theorem 9.2). 


9.3.2 Mathematical treatment of the convolution of distributions* 


In this section we present a mathematically correct treatment of the convolution of 
distributions. In particular we will prove the results that were derived intuitively in 
section 9.3.1. As mentioned at the beginning of section 9.3, section 9.3.2 can be 
omitted without any consequences for the remainder of the book. 

In order to find a possible definition for S * T, we start, as usual by now, with two 
functions / and g for which we assume that the convolution product / * g exists 
and, moreover, defines a distribution by means of (8.12). It then follows for tf> e S 
that 

/ OO rOO / rOO \ 

(/ * g)(t)<t>{t)dt = / l f (r)g(t — z) dx\ f(t) dt. 

-oo 2—oo \J—o o / 

Since we are only looking for the right definition, we might as well assume that we 
may interchange the order of integration. We then see that 


{Tf n .tt>)= f /(*)([ g(t - r)<p(t)dt\dr 
J —oo \J—o o / 

= [ f( T )([ g(t)4>(t + T)dt\dr 

2 — 00 \2 — oo / 


(9.23) 


(change the variable from t — r to t in the last step). For each fixed r e R the 
latter inner integral can be considered as the distribution Tg applied to the function 
ij>{t + t). Here <p(t + r) should be considered as a function of t with r kept fixed. 
In order to show this explicitly, we denote this by ( T g (t ), <p(t + r)); the distribution 
Tg(t ) acts on the variable t in the function <j>(t + r). Now ( T g (t ), ()>(t + r)) is 
a complex number for each r e R and we will assume that the mapping r —»■ 
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DEFINITION 9.3 

Convolution of distributions 


EXAMPLE 9.8 


EXAMPLE 9.9 


( Tg(t), 4>(t + r)) from® into C is again a function in S', let us denote this function 
by fix). The right-hand side of (9.23) can then be written as the distribution re¬ 
applied to this function f (r), which means that (9.23) can now be written as 

(Z/* g , f) = [T f ( r), f(x)) = (7/0:), f(t + r))). 

This finally gives us the somewhat complicated definition of the convolution of two 
distributions. 

Let S and T be two distributions and define for x e K the function fix) by 
fix) — {T ( t ), fit + r)). If for each f e S the function fix) belongs to S, then 
the convolution product S * T is defined by 

(S *T,f) = (Six), fix)) = (Six), (Tit), fit + x))). (9.24) 

The condition that f (x) should belong to S is the reason that often S *T cannot 
be defined. 

For T take the delta function S(t), then the function fix) is given by fix) — 
(T(t), f (t + x)) = (Sit), fit + x)) = fix), because of the definition of Sit). 
Hence, we have fix) = f(x) in this case and so we certainly have that f e S. The 
convolution S * S thus exists for all distributions 5 and (S * S, f) = (Six), fix)) 
if e S). This then proves the identity 5 * S = 5 in (9.19). ^ 

For each distribution T we have that T * S' exists and T * S' = T'. In fact, 
(r * S', f ) = (Tix), [S'it), fit + x ))) = (T(x), —f'i t)), because of the action of 
S' (see (8.19)). Hence T * S' exists and [T * S', f ) = [T, —f') = [T', f ) for all 
f e S (in the last step we used definition 8.4). This proves the identity T * 8' = T' 
in (9.20). M 

Convolution of distributions is not easy. For example, for functions / and g we 
know that f * g = g * f, in other words, the convolution product is commutative 
(see section 6.6). This result also holds for distributions. But even this simplest 
of properties of convolution will not be proven in this book; it would lead us too 
far into the theory of distributions. Without proof we state the following result: if 
S *T exists, then T * S also exists and S *T = T * 5. In particular it follows from 
examples 9.8 and 9.9 that for an arbitrary distribution T one has T * 8 = 8 * T = T 
and T * 8' = 8' *T = T'.ln exactly the same way one obtains more generally that 
for any distribution T and any k e one has 

T * 8 {k) = 8 (k) * T = T {k \ (9.25) 

Convolution of distributions is also quite subtle and one should take great care using 
it. For functions the convolution product is associative', if *g)*h = f *ig*h) for 
functions /, g and h. For distributions this is no longer true. Both the convolutions 
(R * S) * T and R * (S * T) may well exist without being equal. An example: one 
has (1 * S') * e = l'*e = 0*e = 0, while l*(5 / *e) = l*e / = 1*5 = 1! 

Finally, we treat the convolution theorems for distributions. However, even the 
formulation of these convolution theorems is a problem, since the convolution of 
two distributions may not exist. Hence, we first have to find a set of distributions for 
which the convolution exists. To do so. we need a slight extension of the distribution 
theory. We have already noted a couple of times that distributions can often be 
defined for more than just the functions in S. The delta function <5, for example, 
is well-defined for all continuous functions, S' for all continuously differentiable 
functions, etc. Now let £ be the space consisting of all functions that are infinitely 
many times differentiable. All polynomials, for example, belong to the space £. Any 
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Distribution on £ 

EXAMPLE 

EXAMPLE 


THEOREM 9.2 
Convolution theorem for 
distributions 


EXAMPLE 9.10 


EXAMPLE9.il 


EXAMPLE 9.12 


function in S belongs to £ as well, since functions in S are in particular infinitely 
many times differentiable (see definition 6.3). 

Now let T be a distribution, so T is a linear mapping from S to C. Then it could 
be that T is also well-defined for all functions in £, which means that {T, (j>) is also 
meaningful for all f e £ (note that more functions belong to £ than to 5: S is a 
subset of £). If this is the case, then we will say that T is a distribution that can be 
defined on £. Such distributions play an important role in our convolution theorems. 

The delta function and all the derivatives of the delta function belong to the distri¬ 
butions that can be defined on £. ^ 

(This example uses the comb distribution from section 9.1.3*.) The comb distribu¬ 
tion \I2 cannot be defined on the space £. This is because the function fit) — 1 
is an element of £ (the function 1 is infinitely many times differentiable with all 
derivatives equal to 0) and (tt?, <jfj = YlkL-oo 0 W — HbL-oo 1 diverges. ^ 

Distributions that can be defined on £ form a suitable class of distributions for 
the formulation of the convolution theorem. 

Let S and T be distributions with spectra U and V respectively. Assume that S is 
a distribution that can be defined on the space £. Then U is a function in £, both 
S *T and U ■ V are well-defined , and S * T U ■ V. 

We will not prove this theorem. It would lead us too far into the distribution 
theory. However, we can illustrate the theorem using some frequently occurring 
convolution products. 

Take for S in theorem 9.2 the delta function S. The delta function can certainly be 
defined on the space £. The spectrum U of 5 is the function 1 and this is indeed a 
function in £. Furthermore, T(8*T) = T8 ■ TT according to theorem 9.2. But this 
is obvious since we know that 8 * T = T and T8 = 1 (also see section 9.3.1). ^ 

One can define 8' on the space £ as well. Furthermore, we showed in section 9.2.2 
that S' -o- ico. Note that the spectrum U of 8' is thus indeed a function in £. Apply¬ 
ing theorem 9.2 establishes that 8' *T -t* icoV when T -o- V. This result can again 
be proven in a direct way since we know that 8' * T = T' and T' -o- icoV when 
T V (also see section 9.3.1). ^ 

Often, the conditions of theorem 9.2 are not satisfied in applications. If one 
doesn’t want to compromise on mathematical rigour, then one has to check case 
by case whether or not the operations used (multiplication, convolution, Fourier 
transform) are well-defined. The result 5 * T -o- U ■ V from theorem 9.2 will then 
turn out to be valid in many more cases. 

Finally, we expect on the basis of the reciprocity property that a convolution 
theorem in the frequency domain exists as well (compare with section 7.2.4). We 
will content ourselves with the statement that this is indeed the case: S ■ T ** 
( U * V)/2n, if all operations occurring here are well-defined. This is the case 
when, for example, U is a distribution that can be defined on the space £. 

Take for S the function e lat , considered as a distribution. The spectrum U of 5 is 
2tz8(co — a) (see example 9.1) and this distribution can indeed be defined on the 
space £. For an arbitrary distribution T with spectrum V it then follows from the 
convolution theorem in the frequency domain that the spectrum of e la, T is equal to 
(2n8(u> — a) * V)/2n. Hence, e ia, T <-> 8(a) — a) * V when T <-> V. Note that 
according to the shift property in the frequency domain one has e la, T -o- V(co — a) 
(see exercise 9.15). Apparently, 8{a> — a) * V = V(to — a). ^ 
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EXERCISES 

9.18 Show that S'(t — a) is an odd distribution. 

9.19 Show that S' * \ t \ = sgnt. 

9.20* Let T(t) be a distribution and a e R. Show that T(t) * S(t — a) exists and that 

T(t) * 8(t — a) = T(t — a) (see example 9.12). 

9.21* Prove that S(t — b) *S(t — a) = S(t — (a + b)) ( a, b e R). Look what happens when 

you apply the convolution theorem to this identity! 

9.22* Let the piecewise smooth function / be equal to 0 outside a bounded interval; say 

f(t) = 0 for 1 1 1 > A (where A > 0 is a constant). 

a Prove that the spectrum F of f exists (in the ordinary sense). Hint (which also 
applies to parts b and c): the function / is bounded, 
b Show that / defines a distribution by means of (8.12). 
c Show that the distribution defined in part b is also well-defined on £. 
d Let T be an arbitrary distribution with spectrum V. We simply write / and F 
for the distributions defined by the functions / and F. Conclude from part c that 
f * T exists and that f * T -o- F ■ V. 

e Determine the spectrum of pi * e (p 2 is the block function, e the unit step 
function). 

f Determine the spectrum of f(r) dr = (/ * e)(t). 

9.23* For functions the only solution to f'(t) = 0 (for all t e R) is the constant function 

f(t ) = c. In this exercise we assume that the same result is true for distributions: 
the only distribution T with T' = 0 is the distribution T = c (c a constant). Using 
this assumption one can determine the spectrum U of the distribution pv(l /t) in a 
mathematically rigorous way. 

a Use the result t • pv(l ft) = 1 from exercise 8.25 to show that U satisfies the 
equation U' = —2ni8(to). 

b Show that all solutions of the equation S' = 8 are necessarily of the form S — 
e + c, where c is a constant. (Hint: when both Si and S 2 are solutions to S' = <5, 
what then will Sj — S 2 satisfy?) Conclude that U ( u >) = —2ni(e(a>) + c). 
c Conclude from exercise 8.27a that U is odd. Use this to determine the constant 
c front part b and finally conclude that U (to) — — 7tisgn to. 


SUMMARY 

The Fourier transform TT of a distribution T is defined by (JTT, tj>) = (T, 4>), 
where <1> is the Fourier transform of tj> e S. In this way the Fourier transform is 
extended from functions to distributions. The most well-known Fourier pair for dis¬ 
tributions is 8(t) 1 and 1 -o- 2n8(to). More generally one has 8(t — a) -o- e~ laa> 

and e lat 2n8(co — a). The latter result can be used to determine the spec¬ 
trum, in the sense of distributions, of a periodic signal which defines a distribution 
and, moreover, has a convergent Fourier series. Another important Fourier pair is 
pv(l/ 1) -o- — ni sgn to and sgn 1 -o- — 2ipv(l/c<)), from which it follows in particular 
that eft) n8(to) — i'pv(l/a>). Finally, we mention the comb distribution or im¬ 
pulse train t V(t), whose spectrum is again a comb distribution, but scaled by 1 /27r: 
m) W(co/2n), or 8(t - k ) «> 2n Y.T=-oo ~ 2jtk '>• 

Quite a few of the properties of the ordinary Fourier transform remain valid for 
distributions. When U is the spectrum of T, then 2nT(co) is the spectrum of U (— t) 
(reciprocity). Furthermore, one has the differentiation properties T® (ito) k U 
and (-it) k T ++ U (k \ as well as the shift properties T(t — a) e iaco U (a>) and 
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9.24 


9.25 


9.26 


9.27 


e ,at T(t) U(co — a). Since the spectrum of e(t) is known, the latter property can 

be used to determine the spectrum of switched-on periodic signals. 

Convolution theorems do not hold for arbitrary distributions. In general, mul¬ 
tiplication as well as convolution of two distributions are not well-defined. When 
5 and T are distributions with spectra U and V, then the convolution theorems 
S * T -o- U ■ V and S ■ T -o- ({/ * V)/2n are correct whenever all the opera¬ 
tions occurring are well-defined. One has, for example, that <5® * T (k e Z + ) 
is well-defined for each distribution T and that 5® * T = T * <5® = 7 1 ® and 
5® * T -v> ( ico) k U when T ■«> U. A list of some standard Fourier transforms 
of distributions and a list of properties of the Fourier transform of distributions are 
given in tables 5 and 6. 


SELFTEST 

Determine the spectra of the following distributions: 
a 8(t- 3), 
b cos 18(t + 4), 
c t 2 e(t), 
d (2e(f) cos t)', 

e {8(It - 1))', 

f | - | ZkL-ooW + ir 2 e (2k+l)it . 

Find the distributions whose spectrum is given by the following distributions: 
a <5(&» — 1) — S(cu + 1), 
b co 2 , 
c e'®/ 2 /4, 
d or’ sin a>, 
e cos(w — 4). 

Consider the distribution U = (co — l) 2 in the frequency domain, 
a Use the shift property to determine a distribution whose spectrum is U. 
b Use the differentiation property to determine a distribution whose spectrum is 
the distribution co 2 — 2co + 1. 

c Note that U = co 2 — 2co + 1; the answers in parts a and b should thus be the 
same. Give a direct proof of this fact. 

Let T be a distribution with spectrum U. 

a Use the convolution theorem to determine the spectrum of T * 8" in terms of U. 
Check the result by applying the differentiation property to the distribution T". 
b The function 1 1 \ defines a distribution. Let V be the spectrum of 1 1 1. Show that 
8" * [ t \ = 28 and prove that V satisfies co 2 V = —2. 
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CHAPTER 10 


Applications of the Fourier integral 


INTRODUCTION 


The Fourier transform is one of the most important tools in the study of the transfer 
of signals in control and communication systems. In chapter 1 we have already dis¬ 
cussed signals and systems in general terms. Now that we have the Fourier integral 
available, and are familiar with the delta function and other distributions, we are 
able to get a better understanding of the transfer of signals in linear time-invariant 
systems. The Fourier integral plays an important role in continuous-time systems 
which, moreover, are linear and time-invariant. These have been introduced in chap¬ 
ter 1 and will be denoted here by LTC-systems for short, just as in chapter 5. 

Systems can be described by giving the relation between the input u{t) and the 
corresponding output or response y(t). This can be done in several ways. For 
example, by a description in the time domain (in such a description the variable 
t occurs), or by a description in the frequency domain. The latter means that a 
relation is given between the spectra (the Fourier transforms) U (co) and Y (a>) of, 
respectively, the input u(t) and the response y(t). 

In section 10.1 we will see that for LTC-systems the relation between u{t) and 
y(t) can be expressed in the time domain by means of a convolution product. Here 
the response h(t) to the unit pulse, or delta function, S(t) plays a central role. In fact, 
the response y(t) to an input u(t) is equal to the convolution product of h(t), the so- 
called impulse response, and u(t). Hence, if the impulse response is known, then 
the system is known in the sense that the response to an arbitrary input can be deter¬ 
mined. Properties of LTC-systems, such as stability and causality, can then imme¬ 
diately be derived from the impulse response. Moreover, applying the convolution 
theorem is now obvious and so the Fourier transform is going to play an important 
role. 

In section 10.2 we will see that the frequency response H(a>) of a system, which 
we introduced in chapter 1, is nothing else but the Fourier transform of the impulse 
response, and that a description of an LTC-system in the frequency domain is simply 
given by Y ( a >) = U (id)H(id), where U ( a >) and Y(a>) are the spectra of, respectively, 
the input u(t) and the corresponding output y(t). Properties of a continuous-time 
system can then also be derived from the frequency response. For an all-pass system 
or a phase shifter, for example, which is an LTC-system with the property that the 
energy-content of the output is equal to the energy-content of the corresponding 
input, the modulus of the frequency response is constant. Another example is the 
ideal low-pass filter, which is characterized by a frequency response being 0 outside 
a certain frequency band. 

Continuous-time systems occurring in practice usually have a rational function 
of a> as frequency response. Important examples are the electrical RCL-networks 
having resistors, capacitors and coils as their components. The reason is that for 
these systems the relation between an input and the corresponding response can 
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LTC-system 


be described in the time domain by an ordinary differential equation with constant 
coefficients. These will be considered in section 10.3. 

Applications of the Fourier transform are certainly not limited to just the trans¬ 
fer of signals in systems. The Fourier integral can also be successfully applied to 
all kinds of physical phenomena, such as heat conduction, which can be described 
mathematically by a partial differential equation. These kinds of applications are 
examined in section 10.4. 

LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know the concepts of impulse response and step response of an LTC-system and 
can determine these in simple cases 

- know the relation between an input and the corresponding output and can apply it 
to calculate outputs 

- can determine the stability and causality of an LTC-system using the impulse re¬ 
sponse 

- know the concept of frequency response and can determine it in simple cases 

- know the relation between the input and the output in the frequency domain and 
can apply it to calculate outputs 

- know what is meant by an all-pass system and an ideal low-pass filter 

- can determine the impulse response of a stable and causal LTC-system described 
by a linear differential equation with constant coefficients 

- can apply the Fourier transform in solving partial differential equations with initial 
and boundary conditions. 


10.1 The impulse response 

In order to introduce the impulse response, we start, as in chapter 1, with an example 
of a simple continuous-time system, namely the electrical network from figure 1.1 
in chapter 1, consisting of a series connection of a voltage source, a resistor and a 
coil. The relation between the voltage and the current in this network is described by 
(1.1), which we will recall here. We denote the voltage by u(t), however, since we 
will consider it as an input, and the current by y(t), being the corresponding output. 
Relation (1.1) mentioned above then reads as follows: 

1 C 

y(t)=- e~ {t ~ z)R/L u(T)dT. (10.1) 

L J—o o 

In chapter 1 we have seen that this relation allows us to consider the network as 
a continuous-time system which is linear and time-invariant. We recall that we 
denote this by LTC-system for short. First we will show that relation (10.T) between 
the input u(t) and the corresponding output y(t) can be written as a convolution 
product. For this we utilize the unit step function eft). Since eft — r) = 0 for r > t, 
it follows that 

/ t rOO 

e~ {, ~ T '> R ! L u {x) dr — / e~^~ x ^ R / L e{t — t)u(j) dr. 

-oo J—oo 

From definition 6.4 of the convolution product we then obtain that 
y(t) = (h * u) (t ), 
where hft) is the signal 

hft) = ^e~ ,R/L e(t ). 
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Superposition 


Superposition rule 


Impulse response 


EXAMPLE 10.1 

Distortion free system 


If we now take as input the unit pulse or delta function 5(f), then it follows from 
(9.19) that h(t) = (h * S)(t) and so we can view h(t) as the output corresponding 
to the unit pulse. We will show that for LTC-systems in general, the response to the 
unit pulse plays the same important role. To this end we first use property (9.19) to 
write an input u(t) in the form 

/ oo 

u{x)8(t — t) dx. 

-oo 


We say that the signal u(t) is now written as a (continuous) superposition of shifted 
unit pulses 5(f — x). Now if hit) is the response to 5(f), then, by the time-invariance 
of the system, the response to 5(f — r) is h(t — x). Next, we tacitly assume that for 
LTC-systems the linearity property can be extended to the so-called superposition 
rule. By this we mean that the linearity property not only holds for finite sums of 
inputs, but also for infinite sums of inputs, and even for ‘continuous sums’, that is, 
for integrals. Applying this superposition rule gives for a system L: 


/: 


■/. 


y(t ) = Lu(f) = L / u(x)8(t — x)dx 


u(x)h(t — x) dx. 



u(x)h8(t — x) dx 


The signal li(t) is called the impulse response of the system L. Hence, 


5(f) i-» hit). (10.2) 

We have now established the following important property for LTC-systems. 

Let u(t ) be an input of an LTC-system L with impulse response h(t). Then 
L u(t) = (h * u)(t). (10.3) 


A continuous-time system is called distortion free when the response y(f) to an 
input u(t) is given by 

y(t) - Ku{t - t 0 ), 

where K and fp are constants with K > 0. Compared to the input, the response is 
of the same form and is shifted over a time fp. This system is an LTC-system. The 
linearity can easily be verified. The time-invariance follows from 

u(t — fj) Ku{t — t\ — to) — y(t — fj) for all t\. 

Also note that the given system is causal if fp > 0. The impulse response is the 
response to 5(f) and thus equal to h{t) = K8(t — to). According to (10.3) the 
response y(f) to an input u(t) is then given by 

/ oo 

u(x)8{t — fp — t) dx = Ku{t — to). 

-oo 

◄ 

By (10.3), an LTC-system is completely determined by the impulse response. 
Hence, all properties of an LTC-system can be derived from the impulse response. 
For instance, an LTC-system is real if and only if the impulse response is real (see 
exercise 10.1b) and an LTC-system is causal if and only if the impulse response is 
causal (see exercise 10.1a). Another property, important for the physically realizable 
systems, is stability as defined in definition 1.3. Using the impulse response one can 
verify this property in the following way. 



232 


10 Applications of the Fourier integral 


THEOREM 10.1 


EXAMPLE 10.2 


An LTC-system with impulse response h{t) (h(t) being an ordinary function) is sta¬ 
ble if and only if f_ oc I h(t) \ dt is convergent, in other words, ifh{t) is absolutely 
integrable. 


Proof 

Let I hit) \ dt be convergent and let the input u(t) be bounded, that is to say, 
there exists a number M such that | u(t) \ < M for all t. For the corresponding 
response it then follows from (10.3) that 


|y(0l = 


-l£ 


u(r)h{t — t) dr 


< M 


/: 


| h (t) [ dr. 


/ oo 

| u(r) | [ h(t — r) | dr 
-oo 


The output is thus bounded and so the system is stable. 
Now let f_ 00 | h(t) | dt be divergent. Take as input 


u(t) = 


h(~t) 

I h(—t) | 

0 


for h(—t) / 0, 
for h(—t) = 0. 


This signal is bounded: | u(t) \ < 1. Using (10.3) we find for the corresponding 
response y(t) at / = 0: 

/ OO rOO 

u(r)h(—r)dr = I \h(r)\dr = oo. 

-oo J —oo 

The response is not bounded and so the system isn't stable. g 


Strictly speaking, we cannot apply this theorem when instead of an ordinary func¬ 
tion h (0 is a distribution, so for example when h (t) = S (t). In fact, for a distribution 
the notion ‘absolute integrability’ has no meaning. Consider for example the dis¬ 
tortion free system from example 10.1. The impulse response is the distribution 
KS(t — to). Still, this system is stable, as follows immediately from definition 1.3 
of stability. For if | u(t) | < M for all t and a certain M, then one has for the corre¬ 
sponding response that | y(t) \ = K \u(t — to) \ < KM, so the response is bounded 
as well. 

For systems occurring in practice the impulse response will usually consist of 
an ordinary function with possibly a finite number of shifted delta functions added 
to this. In order to verify the stability for these cases, one only needs to check 
the absolute integrability of the ordinary function. We will demonstrate this in the 
following example. 

A system L is given for which the relation between an input u(t) and the response 
y(t) is given by 

y(t) = u(t — 1) + f e~ 2(, ~ r \t(r) dr. 

J—o o 

In exercise 10.2 the reader is asked to show that L is an LTC-system. The impulse 
response can be found by substituting the unit pulse <5 (t) for u(t), resulting in h(t) — 
8(t — 1) + r(t), where r(t) = e~ 2, e(t). The response y(t) to an input u(t) can be 
written as y(t) = u(t — 1) + yi(t), where y\ (t) is the response to u(t) of an LTC- 
system with impulse response h j (t) = r(t). Since 

/ OO rOO 

| h\(t) | dt = I e~ 2t dt = i < oo, 

-oo J 0 
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EXAMPLE 10.3 

Integrator 


Step response 


10.1 


10.2 


the system is stable according to theorem 10.1. Soif|«(f)| < M, then | yj (f) | < L 
for some L and we thus have 


I y(t) | < \u{t- 1)| + L < M + L. 

This establishes the stability of the LTC-system. 


An LTC-system for which the relation between an input u(t) and the corresponding 
output y(t) is given by 


y(f) = 


f 

J—O 


u( t) dx 


is called an integrator. Since 

t 


L 


<5(t) dx = e(t). 


the impulse response of the integrator is equal to the unit step function e(t). Accord¬ 
ing to property (10.3) we thus have y{t) = (e * u){t). The unit step function e(t) is 
not absolutely integrable. Hence, it follows from theorem 10.1 that the integrator is 
unstable. ^ 


We close this section with the introduction of the so-called step response a(t) of 
an LTC-system. The step response is defined as the response to the unit step function 
e(t), so 


e(t) a(t). 


(10.4) 


From property (10.3) it follows that a(t) = (e * h)(t), where h(t) is the impulse 
response of the system. Convolution with the unit step function is the same as 
integration (see example 10.3 of the integrator), so 


a(t) = 



h(r) dr. 


(10.5) 


This relation implies that h(t) is the derivative of a(t), but not in the ordinary sense. 
Thanks to the introduction of the distributional derivative, we can say that h (f) is the 
distributional derivative of a(t)\ a'(t) — h(t). Apparently, the impulse response fol¬ 
lows easily once the step response is known and using (10.3) one can then determine 
the response to an arbitrary input. 


EXERCISES 

Given is an LTC-system L. 

a Show that the system L is causal if and only if the impulse response h (f) of L is 
a causal signal. 

b Show that the system L is real if and only if the impulse response h(t) of L is a 
real signal. 

The relation between an input u(t) and the corresponding response y(t) of a system 
L is given by 

y(t) = u(t — 1) + f e~~ l ‘ , ~ T \t(x) dr. 

J—o o 

a Show that L is a real and causal LTC-system. 
b Determine the step response of the system. 
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THEOREM 10.2 


10.3 Given is an LTC-system L with step response a(t). Determine the response to the 
rectangular pulse P 2 ( 0 - 

10.4 Given is a stable LTC-system with impulse response h(t). 

a Show that the response to the constant input u(t) = 1 is given by the constant 
output y(t) = H( 0) for all t, where 

/ oo 

h(z)dT. 

-oo 

b Let u(t) be a differentiable input with absolutely integrable derivative u'(t) and 
for which «(—oo), defined by linv_ > _ 00 u(t), exists. Show that u(t) = u(—oo) + 
(«' * e)(t). 

c Show that for the response y(t) to u(t) one has y(t) = H(0)u(—oo)+(u'*a)(t). 

10.5 For an LTC-system the step response a(t) is given by a{t) = cos(2 t)e~^ r e(t). 

a Determine the impulse response h(t). 
b Show that the system is stable. 

10.6 Given are the LTC-systems Lj and L 2 in a series connection. We denote this so- 

called cascade system by L 2 L 1 . The response y(t) to an input u(t) is obtained as 
indicated in figure 10.1. 


u(t) 




y(t) 


L 1 


l 2 



FIGURE 10.1 

Cascade system of exercise 10.6. 

a Give an expression for the impulse response h(t) of L 2 L 1 in terms of the impulse 
responses fij(r) and li 2 (t) of, respectively, Lj and L 2 (r) . 
b Show that if both Lj and L 2 are stable, then L 2 L 1 is also stable. 

10.2 The frequency response 

In the previous section we saw that for an LTC-system the relation between an in¬ 
put and the corresponding output is given in the time domain by the convolution 
product (10.3). In this section we study the relation in the frequency domain. It 
is quite natural to apply the convolution theorem to (10.3). Since we have to take 
into account that delta functions may occur in u(t) as well as in h(t ), we will need 
the convolution theorem that is also valid for distributions. We will assume that for 
the LTC-systems and inputs under consideration, the convolution theorem may al¬ 
ways be applied in distributional sense as well. As a result we obtain the following 
important theorem. 

Let U (a)), Y (to) and H(cd) denote the Fourier transforms of respectively , an input 
u(t), the corresponding output y(t), and the impulse response h(t) of an LTC-system. 
Then 

Y(m) = H(a>)U (a>). (10.6) 

Property (10.6) describes how an LTC-system operates in the frequency domain. 
The spectrum of an input is multiplied by the function H(co), resulting in the spec¬ 
trum of the output. 
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EXAMPLE 10.4 


THEOREM 10.3 

Frequency response 


EXAMPLE 10.5 


Transfer function 
System function 

EXAMPLE 10.6 
Ideal low-pass filter 


The impulse response of the integrator (see example 10.3) is the unit step function 
e(t): h(t ) = e(t). The Fourier transform of h(t) is 1 /(ia>) + Tt8(m) (see table 5; 
—;pv(T/a>) is written as 1 /(ia>) for short). Hence, according to (10.6) the integrator 
is described in the frequency domain by 

Y(co) = (l/(iw) + tc8(co)) U(to) = U(a>)/(ia>) + nU(m)8(m) 

= U(a})/(ia>) + nU(0)8(a>). 

In the last equality we assumed that U ( a> ) is continuous at to = 0. ^ 

In this example of the integrator we see that substituting to = 0 is meaningless. 
The reason for this is the instability of the integrator. For stable systems the impulse 
response h(t) is absolutely integrable according to theorem 10.1 and FI((d) will then 
be an ordinary function, and even a continuous one, defined for all to (see section 
6.4.11). 

Now consider in particular the time-harmonic signal u(t) = e uot with frequency 
to as input for an LTC-system. According to property (10.3) the response is equal to 

/ oo 

h(r)e iQ)(t ~ T) dr = H(co)e Uot . 

-oo 

Hence, 

e iwt ^ H(co)e imt . (10.7) 

This is nothing new. In chapter 1 we have derived that the response of an LTC-system 
to a time-harmonic signal is again a time-harmonic signal with the same frequency. 
In this chapter the frequency response H (at) has been introduced through property 
(10.7). We conclude that the following theorem holds. 

The frequency response H(co) of an LTC-system is the spectrum of the impulse re¬ 
sponse: 

h(t) i-> H(w). (10.8) 


For an LTC-system the impulse response is given by h(t) = e~'e(t). The system is 
stable since 

/ oo poo 

| h(t) | dt = / dt = 1 < oo. 

-oo JO 

The Fourier transform of h(t) can be found in table 3: H(a>) = 1/(1 + ico). The 
response to the input e l(ot is thus equal to e lmt /(I + ico). ^ 


From chapter 1 we know that the frequency response H (a>) is also called the 
transfer function or the system function of an LTC-system. Apparently, an LTC- 
system can be described in the frequency domain by the frequency response H(a>). 


As an example we consider the so-called ideal low-pass filter with frequency re¬ 
sponse H (a>) given by 


H(eo) = 


e imt ° for | a> | < a>c, 
0 for | a> | > a> c . 


Hence, only frequencies below the cut-off frequency co c can pass. By an inverse 
Fourier transform we find the impulse response of the filter: 


1 r c 

h{t)= ^L 


H(co)e uot dm = — 


1 r a 

2n 


sin(a) c (f — t 0 )) 


n(t - t 0 ) 
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The function h(t) is shown in figure 10.2. The impulse response h(t) has a maxi¬ 
mum value cuc/ir at t = to', the main pulse of the response is concentrated at t = tQ 
and has duration 2 n/m c . Note that h(t) is not causal, which means that the system 
is not causal. The step response of the filter follows from integration of h(t): 


alt ) = 



h(r ) dr 



sin(a> c (T - to)) , 1 /‘" c(r ^ 

- dr = — 

7t{r to) tc J—oo 


sinx 

- dx, 

x 


where we used the substitution a> c (r — to) = x. Using the sine integral (see chapter 
4), the step response can be written as 


1 1 

a(t) = - + —Si(a>c (t - t 0 )). 
2 n 


Note that fl(fo) = \ and that the initial and final values a(—oo) — 0 and a(oo) — 1 
are approached in an oscillating way (see figure 10.2b). The maximal overshoot 
occurs at t = tQ + n/a> c and amounts to 9% (compare this with Gibbs’ phenomenon 
in chapter 4). In this example we will also determine the response to a periodic 


a b 



FIGURE 10.2 

Impulse response (a) and step response (b) of ideal low-pass filter. 


signal u(t) given by the Fourier series 

oo 

u(t)= J2 a n e inm ‘, 

n =—oo 


where coq = 2n/T. According to property (10.7), the response to e lnm ’ equals 


H(ncoo)e inc0ot = 


f °^ for | na>o \ < a> c , 

0 for | net )o | > co c . 


Here we assume that a> c is not an integer multiple of coq. Let N be the integer 
uniquely determined by Ncl>o < co c < (N + 1 )o)q. For the response y(t) to the 
periodic input u(t) it then follows that 


N 

y(t) = J2 c n e inM °(t-‘o) = UN (t-to), 

n=—N 


where uy/(t) denotes the (Vth partial sum of the Fourier series of u(t). 


The frequency response can also show us how the energy-content (see section 
1.2.3) of an input is effected by an LTC-system. When an energy-signal u(t) is 
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All-pass system 
EXAMPLE 10.7 


applied to an LTC-system, then by Parseval’s identity (see (7.19)) one has for the 
energy-content of the corresponding output y(t) that 

/ OO ] pOO | r OO 

\y(t)\ 2 dt=— / | Y(a>) | 2 da) = -— / | H(a>) | 2 | U(a>) | 2 den. 

-OO ^ J— OO ^ J— OO 

Note that for LTC-systems whose amplitude response | H(co) | is identical to 1, the 
energy-content of the output equals the energy-content of the input. Such a system 
is called an all-pass system. 

For an LTC-system the frequency response H(a>) is given by 




—unto 


1 + iat 
Here fp is real. Since 


m ~ i ..-i<nt n 


co — i 

lea 2 + 1 

1 + 


1 + ico 

VI +co 2 


the system is an all-pass system. 


◄ 


In this section we have established the importance of the frequency response for 
LTC-systems. An important class of LTC-systems in practical applications has the 
property that the frequency response is a rational function of a>. Examples are the 
electrical networks. In the next section we will examine these in more detail. 


10.7 


10.8 


10.9 


EXERCISES 


For an LTC-system L the impulse response is given by h(t) = 8 (t) + re -f 6(f). 
a Determine the frequency response of the system L. 

b Determine for all real u> the response of the LTC-system to the input u(t) = e lwt . 


For an LTC-system L the frequency response is given by 

COSfO 

H(p>) = 


of 1 + 1 


a Determine the impulse response h(t) of the system L. 
b Determine the response to the input u(t ) = 8(t — 1). 


For a low-pass filter the frequency response H(a>) is given by the graph of 
figure 10.3. 



FIGURE 10.3 

Frequency response of the low-pass filter of exercise 10.9. 
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FIGURE 10.4 

Periodic signal u(t) of exercise 10.9. 



FIGURE 10.5 

Band-pass filter of exercise 10.10. 


10.10 

Band-pass filter 


10.11 


10.12 

Band-limited signal 


a Determine the impulse response of the filter. 

b To the filter we apply a periodic signal u(t ) with period 2n which, on the time 
interval [0, 2 jt), is given by the graph of figure 10.4. Find the response to this 
periodic signal u(t). 

For an ideal band-pass filter the frequency response is given by the graph of 
figure 10.5. 

a Determine the impulse response of the filter, 
b Use the sine integral to determine the step response of the filter. 

For an LTC-system the frequency response H (co) is given by 

i a> + 1 i co — 2 
H(co) = --r * ~ ' 

ICO — 1 1(0+1 

a Determine the impulse response of the system, 
b Is the system causal? Justify your answer. 

c To the system we apply a signal u(t) with a finite energy-content. Show that 
the energy-content of the response y(t) to u(t) is equal to the energy-content of the 
input u(t). 

An LTC-system with frequency response H(co) is given. To the system we apply 
a so-called band-limited signal u(t). This means that the spectrum U(co ) satisfies 
U ( co ) = 0 for \(o\> a>c for some co c > 0. 
a Show that the output y(t) is also band-limited. 
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b For the band-limited signal the values u(nT) for n eZ are given, where T is 
such that a>s = 2n/T > 2a> c . In chapter 15 we will derive that this signal can then 
be written as 


r(?) = u(nT ) 


2 sin( 70 ) s (? — nT)) 
a> s (f — nT) 


Show that for the response y(t) one has 
oo 

y(t) = ^2 u(nT)h a (t - nT), 

n=—o o 


where h a (?) is the signal given by 

1 /’“s/ 2 • , 

h a (t)=—\ H{rn)e ,mt dm. 

«s J-cos/2 


EXAMPLE 10.8 


10.3 Causal stable systems and differential equations 

An example of an LTC-system, occurring quite often in electronics, is an electric 
network consisting of linear elements: resistors, capacitors and inductors, whose 
properties should not vary in time (time-invariance). For these systems one can 
often derive a differential equation, from which the frequency response can then be 
determined quite easily (see theorem 5.2). From this, the impulse response can be 
determined by using the inverse Fourier transform, and subsequently one obtains the 
response to any input by a convolution. Let us start with an example. 

In figure 10.6 a series connection is drawn, consisting of a voltage source, a resistor 
with resistance R and a capacitor with capacitance C. This circuit or network can 
be considered as a causal LTC-system with input the voltage u(t) drop across the 
voltage source and with output the voltage drop y(t) across the capacitor. We will 


/(?) 

> 



- * - 1 1 - 

R 

* 

+ 



u(t) ( 

) 

= y(t) j 



i 


FIGURE 10.6 
An RC-network. 

now determine the impulse response. The frequency response can be obtained as 
follows. Let i(t) be the current in the network, then it follows from Kirchhoff’s 
voltage law and Ohm’s law that 

u(t) = Ri(t) + y(t). 

The voltage-current relation for the capacitor is as follows: 

1 f 

y(t) = — / i(r)dT. 

J —oo 
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By differentiation it follows that the relation between u(t) and y (0 can be described 
by the following differential equation: 

dy 

RC — + v(r) = u{t). 
dt 

From theorem 5.2 it then follows that the frequency response H(a>) is equal to 


H(co) = 


1 

1 + itoRC 


Finally, the impulse response is obtained by an inverse Fourier transform. From 
table 3 we conclude that 


h(t) = J- e -^ RC €(t). 

K C 

By (10.3), the response to an arbitrary input u(t ) then equals 


y(t) = (u * h)(t) = 


1 

~RC 


f u(z)e~^l RC dr. 
J—o o 


◄ 


In this section we will consider causal and stable LTC-systems described in the 
time domain by an ordinary differential equation with constant coefficients. Exam¬ 
ples are the electrical networks with resistors, capacitors and inductors, the so-called 
RLC-networks, having one source (a voltage or current source); see also chapter 5. 
Using Kirchhoff’s voltage law and the voltage-current relations for the resistor, ca¬ 
pacitor and inductor, one can derive that the relation between the input u(t ) and 
the response y(t) in such networks can always be described by a linear differential 
equation with constant coefficients of the form 


jm — 1 , 


d m y d”' ‘y 

a ”'~dt^ +am ~ l ~d?^ + ' 

, d n u d n ~ l 

— bn - 1 “ bn — 1 - 7 

dt n dt"- 1 


dy 

• • + fl i “TT + a oy 

clt 

u du 

+ • • • + b\ — -K oqU 

at 


(10.9) 


with n < m. Causal and stable systems described by (10.9) are of practical impor¬ 
tance because they can physically be realized, for example as an electric network. 

If we have a complete description of a system, then the response y(t ) to a given 
input u(t) must follow uniquely from the given description. For periodic signals 
this problem has already been discussed in chapter 5, section 5.1. However, if u(t) 
is known in (10.9) (and so the right-hand side is known), then we know from the 
theory of ordinary differential equations that a solution y(0 still contains m (the 
order of the differential equation) unconstrained parameters. Apparently, more data 
from the output or the system are required to determine y(0 uniquely for a given 
u{t). If, for example, y(0 and all the derivatives of y(t) up to order m — 1 are known 
at t = 0, that is to say, if the initial values are known, then it follows from the theory 
of ordinary differential equations that y(t) is uniquely determined for all t. 

In this chapter we will assume that the differential equation (10.9) describes a 
causal and stable LTC-system. The impulse response is then causal and, after re¬ 
moving delta functions that might occur (see example 10.2), absolutely integrable. 
Using this, one is able to find a unique solution for the impulse response by sub¬ 
stituting u(t ) = <5(0 in (10.9). It is easier, though, to first calculate the frequency 
response (see theorem 5.2). According to theorem 5.2 one can use the characteris¬ 
tic polynomial A(s) — a m s m + a m _[S m ~ i + • • • + ujJ + oq and the polynomial 
B(s) = b n s n + b n _\s n ~ 1 + • • • + b[S + bo to write the frequency response as 


A(ico)H(a>)e i<ot = B{ico)e Uot . 
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THEOREM 10.4 


EXAMPLE 10.9 


We now impose the condition that A{ico) ^ 0 for all real to, which means that the 
polynomial A(i) has no zeros on the imaginary axis. Dividing by A(iw)e l(ot is then 
permitted, which leads to the result 


b n (i(o) n + b n -\(ico) n 1 H- hb^icol + bg _ B(ia>) 

a m (ia>) m + a m —\(i(o ) m ~ 1 + • • • + ai(ia>) + ag A(ico) 


( 10 . 10 ) 


The frequency response is thus a rational function of to. Because we assumed that 
n < m, the degree of the denominator is at most equal to the degree of the numerator. 
The impulse response follows front the inverse Fourier transform of the frequency 
response. To that end we apply the partial fraction expansion technique, explained 

in chapter 2, to the rational function B(s)/A(s). Let s\,S 2 . s m be the zeros of 

the polynomial A(s) and assume, for convenience, that these zeros are simple. Since 
n < m, the partial fraction expansion leads to the representation 


m 


H(a >) = c 0 + 

k =1 


c k 

ice — S k 


where eg, c j,..., c. m are certain constants. Inverse transformation of cq gives the 
signal co<5(f). Inverse transformation for Res k < 0 gives (see table 3) 

e Skt e(t) -o- -, 

id) — S k 

while for Re s k > 0 it gives (use time reversal) 

—e Sk ‘e(—t) -o- ---. 

id) — SI; 

Finally, when Res k = 0, so s k = *’wo f° r some tag, then 

-e ,a, ° r sgnt ---. 

2 i(a> — cog) 

We have assumed that the system is causal and stable. This then implies that for 
k = 1,2,... ,m the zeros Sf, must satisfy Rei{ < 0. Apparently, the zeros of A(s) 
lie in the left-half plane Re s < 0 of the complex s-plane. The impulse response 
h(t) of the LTC-system then looks as follows: 


m 

h(t ) = c 0 S(t) + ^2 c k e Sk ‘e(t). 
k= 1 

We conclude that for a description of a causal and stable system by means of a 
differential equation of type (10.9), the zeros of A(s ) must lie in the left-half plane 
of the complex j-plane. Hence, there should also be no zeros on the imaginary axis. 
We formulate this result in the following theorem. 


When an LTC-system is described by an ordinary differential equation of type ( 10.9), 
then the system is causal and stable if and only if the zeros s of the characteristic 
polynomial satisfy Re s <0. 


Consider the RC-network from figure 10.7. The input is the voltage drop u(t) across 
the voltage source and the output is the voltage drop y(t) between nodes A and B 
of the network. The network is considered as an LTC-system. The relation between 
u(t) and y(t) is described by the differential equation 



+ y = -RC 


du 

dt 


“b ll. 
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FIGURE 10.7 
An RC-network. 


10.13 


Substituting u(t) = e lcut gives y(t) — H{co)e la>t with H{a> ) equal to 


H(co) = 


1 — icoRC 
1 + ia>RC 


We see that | H(ai) | = 1. Hence, the amplitude spectrum is identical to 1. Appar¬ 
ently, the network is an example of an all-pass system. Furthermore, we see that 
A(s) = 1 + sRC has a zero at s = — 1 /RC. This zero lies in the complex left-half 
plane and so the system is causal and stable. The impulse response follows by an 
inverse transform of H(a>), resulting in 


RC 


◄ 


EXERCISES 

In the circuit of figure 10.8 we have L = 2 R~C. The circuit is considered as an 


u(t) O 



L 






) 

C 

R 

y(t) 


FIGURE 10.8 

Circuit with L = 2 R~C of exercise 10.13. 


LTC-system with input the voltage drop u{t) across the voltage source and output 
the voltage drop y{t) across the resistor R. The relation between u(t) and y(t) is 
given by the differential equation 


d 2 y r dy 2 2 

+w °V2-+a; 0 y=^+< Wo «, 


1 

sfLC' 


where coq = 
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FIGURE 10.9 

RC-network of exercise 10.14. 


10.14 


10.15 


a Determine the frequency response H(w). 
b Determine the response to u(t) = cos(o>oO- 
c Determine the response to u(t) = cos(a>ot)e(t). 

The RC-network from figure 10.9 is considered as an LTC-system with input the 
voltage drop u(t) across the voltage source and output y(t) the voltage drop across 
the resistor and the capacitor. The relation between u(t) and y(t) is given by the 
differential equation 


dy 1 

2— +-y — — 

dt RC y dt 



ll. 


a Determine the frequency response and the impulse response of the system, 
b Consider the so-called inverse system , which takes y(t) as input and u(t ) as 
response. Determine the transfer function H[ (at) and the impulse response h\(t) of 
the inverse system, 
c Determine (h * h{)(t). 

For an LTC-system the impulse response h(t) is given by h(t) = t n e~ at e(t). Here 
n is a non-negative integer and a a complex number with Rea >0. Show that the 
system is stable. 


10.4 Boundary and initial value problems for partial differential 
equations 

In the previous sections it has been shown that the Fourier transform is an important 
tool in the study of the transfer of continuous-time signals in LTC-systems. We 
applied the Fourier transform to signals f(t) being functions of the time t, and 
the Fourier transform F(a>) could then be interpreted as a function defined in the 
frequency domain. However, applications of the Fourier transform are not restricted 
to continuous-time signals only. For instance, one can sometimes apply the Fourier 
transform successfully in order to solve boundary and initial value problems for 
partial differential equations with constant coefficients. In this section an example 
will be presented. The techniques that we will use are the same as in section 5.2 of 
chapter 5. By a separation of variables one first determines a class of functions that 
satisfy the differential equation as well as the linear homogeneous conditions. From 
this set of functions one subsequently determines by superposition a solution which 
also satisfies the inhomogeneous conditions. 
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Again we take the heat equation from chapter 5 as an example, and we will also 
use the notations introduced in that chapter: 

uj = ku xx for.* € R and 1 > 0. (10.11) 

The function u(x, t) describes the heat distribution in a cylinder shaped rod at the 
point x in the longitudinal direction and at time t. Now consider the conditions 

u(x, 0) = f(x) for tel and t > 0, 
u{x, t) is bounded. 

This means that we assume that the rod has infinite length, that the heat distribution 
at time t = 0 is known, and that we are only interested in a bounded solution. A 
linear homogeneous condition is characterized by the fact that a linear combination 
of functions that satisfy the condition, also satisfies that condition. In our case this 
is the boundedness condition. Verify this for yourself. 

Separation of variables gives u(x, t) = X(x)T(t), where A is a function of x 
only and T is a function of t only. In section 5.2 of chapter 5 we derived that 
this u(x, t) satisfies the given heat equation if for some arbitrary constant c (the 
separation constant) one has 

X" - cX = 0, 

T' - ckT = 0. 

In order to satisfy the linear homogeneous condition as well, X(x)T(t ) has to be 
bounded, and this implies that both X ix) and T ( t ) have to be bounded functions. 

From the differential equation for Tit) it follows that T(t) = ae ckt for some a. 
And since T ( t ) has to be bounded for t > 0, the constant c has to satisfy c < 0. 
(Unless a = 0, but then we obtain the trivial solution T it) = 0, which is of no 
interest to us.) We therefore put c — —to 2 , where to is a real number. 

For to = 0 the differential equation for X (x) has as general solution X ix) = 
ax + f. The boundedness of Xix) then implies that a = 0. For to 0 the 
differential equation has as general solution Xix) = ae lu>x + fe~ ,a>x . This function 
is bounded for all a and f since 

| Xix) | < | a | | e iwx | + | f | | e~ i(ox | = | a \ + | f \ . 

From the above it follows that the class of functions we are looking for, that is, 
satisfying the differential equation and being bounded, can be described by 

X(x)Tit) = e i(ox e- ka>2t , where Kiel. 

Now the final step is to construct, by superposition of functions from this class, 
a solution satisfying the inhomogeneous condition as well. This means that for a 
certain function F(aj) we will try a solution u(x, t) of the form 

/ oo , 

Fi(o)e- kmt e i(ox dto. 

-oo 

If we substitute t = 0 in this integral representation, then we obtain that 

/ oo 

Fito)e imx dto. 

-oo 

We can now apply the theory of the Fourier transform. If we interpret to as a fre¬ 
quency, then this integral shows that, up to a factor 2jt, fix) equals the inverse 
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Formal solution 


Fourier transform of F(a>). Hence, F(cl>) is the Fourier transform of fix), up to a 
factor 2 n : 

1 r°° 

Fico) = — / f(x)e~ la>x dx. 

2rr 2—00 

We have thus found a solution of the heat conduction problem for the infinite rod, 
however, without worrying about convergence problems. In fact one should verify 
afterwards that the u (x , t ) we have found is indeed a solution. We will omit this 
and express this by saying that we have determined a formal solution. When, for 
example,/(x) = 1/(1 + x 2 ), then it follows from table 3 that F(a>) = \e~^ w ^ and 
so a formal solution is given by 

u(x,t) = \ [°° e -M e - k( ° 2, e imx dco. 

J—o o 


10.16 


10.17 


EXERCISES 

Let fix) = 1/(1 + x 2 ). Determine formally the bounded solution of the following 
problem from potential theory: 

u xx + Uyy = 0 for —oo < x < oo and y > 0, 

u(x , 0) = f{x) for —oo < x < oo. 

Determine formally the bounded solution T (x, t ) of the heat conduction equation 
T xx = Tt for —oo < x < oo and t > 0 


with initial condition 


Tlx, 0) = 


T\ for x > 0, 

T 2 forx < 0 . 


SUMMARY 

The Fourier transform is an important tool in the study of linear time-invariant 
continuous-time systems (LTC-systems). These systems possess the important prop¬ 
erty that the relation between an input u(t) and the corresponding output y(t) is 
given in the time domain by means of the convolution product 

y{t) = (h * u)(t), 

where h(t) is the response of the LTC-system to the delta function or unit pulse 
S(t). The signal h(t) is called the impulse response. An LTC-system is completely 
determined when the impulse response is known. Properties of an LTC-system can 
be derived from the impulse response. For example, an LTC-system is stable if the 
impulse response, ignoring possible delta functions, is absolutely integrable. 

The step response a it) is defined as the response to the unit step function e(f). 
The derivative of the step response as distribution is equal to the impulse response. 

The frequency response Hico), introduced in chapter 1, turned out to be equal to 
the Fourier transform of the impulse response h[t). The frequency response has the 
special property that the LTC-system can be described in the frequency domain by 


Y{co) = H(xo)U(a>). 
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Here U(a>) and Y (to) are the spectra of, respectively, the input u(t) and the corre¬ 
sponding output y(t). Hence, an LTC-system is known when H(co) is known: in 
principle the response y(t) to any input uft) can then be determined. 

An ideal low-pass filter is characterized as an LTC-system for which H(a>) = 0 
outside the pass-band — co c < to < a> c - An LTC-system for which H(a>) — 1 for all 
a> is called an all-pass system. An all-pass system has the property that the energy- 
content of the output equals the energy-content of the corresponding input. 

For practical applications the causal and stable systems are important, for which 
the relationship between u(t) and y(t) can be described by an ordinary differential 
equation 


d m y d m ~ l v dy 

am l^ +am - l ^T + '" +ai di +aoy 


d n u d n 1 u 

— bfi — -K b n _ 1 -r- 

dt n " 1 dt"- 1 


clu 

■ + by — -h 

dt 


Examples are the electrical networks consisting of resistors, capacitors and induc¬ 
tors, whose physical properties should be time-independent. The frequency re¬ 
sponse is a rational function. Stability and causality can be established by looking 
at the location of the zeros of the denominator of the frequency response. These 
should lie in the left-half plane of the complex plane. 

The Fourier transform can also successfully be applied to functions depending on 
a position variable. Particularly for boundary and initial value problems for linear 
partial differential equations, the Fourier transform can be a valuable tool. 


SELFTEST 


10.18 


10.19 


10.20 


10.21 


A system is described by 
y(t) = f e -fi-r) w ( T ) dr. 

Jt-l 

a Determine the frequency response and the impulse response, 
b Is the system causal? Justify your answer, 
c Is the system stable? Justify your answer, 
d Determine the response to the block function P 2 (t). 

For an LTC-system the step response aft) is given by aft) = e~ l e(t). 
a Determine the impulse response, 
b Determine the frequency response, 
c Determine the response to the input u(t) = e~ t e(t). 


The frequency response of an ideal low-pass filter is given by 


H(eo) = 


1 for | a> | < a>c, 
0 for | a> | > a> c . 


Determine the response to the periodic input u(t) with period T = 5n/a> c given by 
uft) = t for 0 < t < T. 


For an LTC-system the frequency response FI (o>) is given by 

1 — -—- for | a> | < «c, 

a> c 


H(co) = 


0 


for | to | > co c ■ 
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10.22 


10.23 


10.24 


a Determine the impulse response. 

b Show that the step response a(t) is a monotone increasing function. 

The RCL-network of figure 10.10 is considered as an LTC-system with the voltage 
drop u(t) across the voltage source as input and the voltage drop v(f) across the ca¬ 
pacitor as output. The quantities R, L and C are expressed in their respective units 
ohm, henry and farad. The relation between u(t) and y(t) is given by the differential 



+ 




yit) 


i 


FIGURE 10.10 

RCL-network of exercise 10.22. 


equation 


d 2 y n dy 

dt 2 dt 


+ 2y = 


du 

— + u. 
dt 


a Determine the impulse response and the step response, 
b Determine the response to the input u(t) = e~' e(t). 


For an LTC-system L the frequency response is given by 
ico — 1 — i 

H(ai) = - e~ lwt ° where t 0 > 0. 

i co + 1 — i 

a Show that L is an all-pass system, 
b Determine the impulse response, 
c Is the system stable? Justify your answer, 
d Determine the response to the periodic input u(t) = 1 + 2 cos t. 


Determine formally the bounded solution u(x, y) of the following boundary value 
problem: 


u X x ~ 2-Uy = 0 for —cxj < x < oo and y > 0, 

u(x, 0) = xe~ x e(x) for —cx < x < oo. 















Part 4 

Laplace transforms 


INTRODUCTION TO PART 4 


In the previous two parts we considered various forms of Fourier analysis: for peri¬ 
odic functions in part 2 and for non-periodic functions and distributions in part 3. In 
this part we examine the so-called Laplace transform. On the one hand it is closely 
related to the Fourier transform of non-periodic functions, but on the other hand it 
is more suitable in certain applied fields, in particular in signal theory. In physical 
reality we usually study signals that have been switched on at a certain moment in 
time. One then chooses this switch-on time as the origin of the time-scale. Hence, 
in such a situation we are dealing with functions on R which are zero for t < 0, 
the so-called causal functions (see section 1.2.4). The Fourier transform of such a 
function / is then given by 

rOO 

F(w)= / f(t)e~ im, dt , 

Jo 

where co e R. A disadvantage of this integral is the fact that, even for very simple 
functions, it often does not exist. For the unit step function e(f) for example, the 
integral does not exist and in order to determine the spectrum of e(f) we had to 
resort to distribution theory. If we multiply e(f) by a ‘damping factor’ e~ at for 
an arbitrary a > 0, then the spectrum will exist (see section 6.3.3). It turns out 
that this is true more generally: when /(f) is a function that is zero for t < 0 
and whose spectrum does not exist, then there is a fair chance that the spectrum of 
g(t) = e~ at f(t) does exist (under certain conditions on a e R). Determining the 
spectrum of g(t) boils down to the calculation of the integral 


/ f{t)e~ (a+im)t dt 

Jo 

for arbitrary real a and a>. The result will be a new function, denoted by F again, 
which no longer depends on co e R, but on a + ico e C. Hence, if we write 
i = cr + ico, then this assigns to any causal function /(f) a function F(s) by defining 

/■OO 

F(s) = / f(t)e~ st dt. 

Jo 


The function F(s ) is called the Laplace transform of the causal function /(f) and 
the mapping assigning the function F(s) to /(f) is called the Laplace transform. 
When studying phenomena where one has to deal with switched-on signals, the 
Laplace transform is often given preference over the Fourier transform. In fact, the 
Laplace transform has a better way ‘to deal with the switch-on time t = O'. Another 
advantage of the Laplace transform is the fact that we do not need distributions very 
often, since the Laplace transform of ‘most’ functions exists as an ordinary integral. 
For most applications it therefore suffices to use only a very limited part of the 
distribution theory. 
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Another noticeable difference with the Fourier analysis from parts 2 and 3 is the 
role of the fundamental theorem. Although the fundamental theorem of the Laplace 
transform can easily be derived from the one for the Fourier integral, it will play 
an insignificant role in part 4. In order to recover a function f(t) front its Laplace 
transform F(s ) we will instead use a table, the properties of the Laplace transform 
and partial fraction expansions. 

To really understand the fundamental theorem of the Laplace transform would 
require an extensive treatment of the theory of functions from C to C. These func¬ 
tions are called complex functions and the Laplace transform is indeed a complex 
function: to s e C the number F{s) e C is assigned (we recall that, in contrast, 
the Fourier transform is a function from R to C). For a rigorous treatment of the 
Laplace transform at least some knowledge of complex functions is certainly neces¬ 
sary. We therefore start part 4 with a short introduction to this subject in chapter 11. 
A thorough study of complex functions, necessary in order to use the fundamental 
theorem of the Laplace transform in its full strength, lies beyond the scope of this 
book. 

Following the brief introduction to complex functions in chapter 11, we continue 
in chapter 12 with the definition of the Laplace transform of a causal function. A 
number of standard Laplace transforms are calculated and some properties, most of 
which will be familiar by now, are treated. 

Chapter 13 starts with a familiar subject as well, namely convolution. However, 
we subsequently treat a number of properties not seen before in Fourier analysis, 
such as the so-called initial value and final value theorems. We also consider the 
Laplace transform of distributions in chapter 13. Finally, the fundamental theorem 
of the Laplace transform is proven and a method is treated to recover a function 
/(f) from its Laplace transform F(s ) by means of a partial fraction expansion. As 
in parts 2 and 3, we apply the Laplace transform to the theory of linear systems and 
(partial) differential equations in the final chapter 14. 

Pierre Simon Laplace (1749 - 1827) lived and worked at the end of an epoch that 
started with Newton, in which the study of the movement of the planets formed an 
important stimulus for the development of mathematics. Theories developed in this 
period were recorded by Laplace in the five-part opus Mecanique Celeste, which 
he wrote during the years 1799 to 1825. The shape of the earth, the movements of 
the planets, and the distortions in their orbits were described in it. Another major 
work by Laplace, Theorie analytique des probabilites, deals with the calculus of 
probabilities. Both standard works do not only contain his own material, but also 
that of his predecessors. Laplace, however, made all of this material coherent and 
moreover wrote extensive introductions in non-technical terms. 

Laplace's activities took place in a time where mathematicians were no longer 
mainly employees of monarchs at courts, but instead were employed by universities 
and technical institutes. Previously, mathematicians were given the opportunity to 
work at courts, since enlightened monarchs were on the one hand pleased to have 
famous scientists associated with their courts, and on the other hand because they 
realized how useful mathematics and the natural sciences were for the improvement 
of production processes and warfare. Mathematicians employed by universities and 
institutes were also given significant teaching tasks. Laplace himself was professor 
of mathematics at the Paris military school and was also a minister in Napoleon's 
cabinet for some time. He considered mathematics mainly as a beautiful toolbox 
which could benefit the progress of the natural sciences. 

In Laplace’s epoch the idea prevailed that mathematics was developed to such 
an extent that all could be explained. Based on Newton's laws, numerous different 
phenomena could be understood. This vision arose from the tendency to identify 
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mathematics mainly with astronomy and mechanics. It led Laplace to the follow¬ 
ing famous statement: “An intelligence which could oversee all forces acting in 
nature at a specific moment and, moreover, all relative positions of all parts present 
in nature, and which would also be sufficiently comprehensive to subject all these 
data to a mathematical analysis, could in one and the same formula encompass the 
movements of the largest bodies in the universe as well as that of the lightest atom: 
nothing would remain uncertain for her, and the future as well as the past would 
be open to her.” Hence, any newly developed mathematics would at best be more 
of the same. However, in the first decades of the nineteenth century mathemati¬ 
cians, such as Fourier, adopted a new course. In the twentieth century, the view 
that mathematics could explain everything was thoroughly upset. First by quantum 
mechanics, which proved that the observer always influences the observed object, 
and subsequently by chaos theory, which proved that it is impossible to determine 
the initial state of complex systems, such as the weather, sufficiently accurately to 
be able to predict all future developments. Notwithstanding, the Laplace transforms 
remain a very important tool for the analysis and further development of systems 
and electronic networks. 
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CHAPTER 11 


Complex functions 


INTRODUCTION 


In this chapter we give a brief introduction to the theory of complex functions. In 
section 11.1 some well-known examples of complex functions are treated, in partic¬ 
ular functions that play a role in the Laplace transform. In sections 11.2 and 11.3 
continuity and differentiability of complex functions are examined. It will turn out 
that both the definition and the rules for continuity and differentiability are almost 
exactly the same as for real functions. Still, complex differentiability is surpris¬ 
ingly different from real differentiability. In the final section we will briefly go into 
this matter and treat the so-called Cauchy-Riemann equations. The more profound 
properties of complex functions cannot be treated in the context of this book. 

LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know the definition of a complex function and know the standard functions z ", e z , 
sin z and cos z 

- can split complex functions into a real and an imaginary part 

- know the concepts of continuity and differentiability for complex functions 

- know the concept of analytic function 

- can determine the derivative of a complex function. 


DEFINITION 11.1 

Complex function 


Domain 

Range 


EXAMPLE 11.1 


11.1 Definition and examples 

The previous parts of this book dealt almost exclusively with functions that were de¬ 
fined on R and could have values in C. In this part we will be considering functions 
that are defined on C (and can have values in C). 

A function f is called a complex function when f is defined on a subset of C and 
has values in a subset ofC. 

Note that in particular C itself is a subset of C. It is customary to denote the 
variable of a complex function by the symbol z. The set of all z e C for which a 
complex function is well-defined is called the domain of the function. The range of 
a complex function / is the set of values /(z), where z runs through the domain of 
/• 

The function /(z) = z is a complex function with domain C and range C. The 
function assigning the complex conjugate z to each z e C, has domain C and range 
C as well. In fact, since z = z, it follows that z e C is the complex conjugate 
off e C. In figure 11.1 the function /(z) = z is represented: for a point z the 
image-point z is drawn. ^ 
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11 Complex functions 


EXAMPLE 11.2 


Polynomial 
Rational function 



FIGURE 11.1 
The function z —z. 



FIGURE 11.2 

The function z —>■ 1/z. 


Consider the function g assigning the complex number 1/z to z e C, that is, g(z) = 
1/z. According to section 2.1.1 the number 1/z exists for every z e C with z / 0. 
The domain of g is C \ (0). The image of g also is C \ (Oj. In fact, if z e C and 
z / 0, then one has for w = 1/z that g(w) = 1/w = z. In figure 11.2 the function 
1/z is represented; here (p = argz. ^ 

Just as for real functions, one can use simple complex functions to build ever 
more complicated complex functions. The simplest complex functions are of course 
the constant functions /(z) = c, where c e C. Next we can consider positive 
integer powers of z, so /(z) = z" with n e N. By adding and multiplying by 
constants, we obtain the polynomials p(z) = a n z n + a„_iz"~* + • • • + a\z + a q, 
where a; e C for each i. Finally, we can divide two of these polynomials to obtain 
the rational functions p(z)/q{z), where p(z) and q{z) are polynomials. As in the 
real case, these are only defined for those values of z for which q(z) 0. 

In section 2.1.1 we have seen that C can also be represented as points in R 2 : the 
complex number z = x+iy is then identified with the point (x, y) el 2 . If we now 
write /(z) = f(x + iy) = u + iv with K.vel, then u and v will be functions of 
x and y. Hence, 


/(z) = u(x, y) + iv(x, y), 
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Real and imaginary part of 
complex function 

EXAMPLE 

EXAMPLE 11.3 

EXAMPLE 11.4 


DEFINITION 11.2 
Complex exponential 

THEOREM 11.1 


where u and v are functions from R 2 to R. The functions u and v are called, respec¬ 
tively, the real and imaginary part of the complex function /. 

The function f(z) = z has the function u(x, y) = * as real part and v{x, y) = y as 
imaginary part. ^ 

The function f(z) = l/z has real part u(x, y) = x/(x~ + y 2 ) and imaginary part 
v(x, y) = —y/(x~ + y 2 ). In fact (also see section 2.1.1): 

1 1 x — iy x — iy x y 

z x + iy (x + iy)(x - iy) x 2 + y 2 „v 2 + y 2 x 2 + y 2 

Consider the complex function g(z) = z 2 . One has (x + iy) 2 = x 2 — y 2 + 2 ixy. 
Hence, the real part of g is u(x, y) = x 2 — y 2 , while the imaginary part is given by 
v(x, y) = 2xy. ^ 

The most important function in Fourier analysis is without any doubt the complex¬ 
valued function e ,y = cosy + i siny, y e R (see definition 2.1). In the Laplace 
transform the role of this function is taken over by the complex function e z . In 
section 2.1.1 we have already defined e z for z € C, since we regularly needed the 
complex-valued function e zt . Here z e C is fixed and teR varies. The following 
definition is, of course, in accordance with definition 2.1, but it emphasizes the fact 
that we now consider e z as a complex function. 

For z = x + iy we define e z by 

e z — e x e iy — e Y (cosy + i sin v). (11.1) 

When z = iy with y e R, then this coincides with definition 2.1 given earlier in 
section 2.1.1; when z = x with x e R, then the definition agrees with the usual (real) 
exponential function e x . By the way, it immediately follows from the definition that 
e z = u(x, y) + iv(x,y) with u(x,y) = e x cosy and i'(jt,y) = e x sin y. The 
definition above ensures that the characteristic property e a+b — e a e b of the real 
exponential function remains valid. 

The function e z has the following properties: 
a e z+w = e z e w for all w, z e C; 

b | e Y+! - v | = e x ; in particular one has e z 0 for ail zeC. 

Proof 

Let z = a + ib and w = c + id with a , b,c,d e R. Then we have e z+w — 
e (a+c)+i(b+d) _ e a+c g i(b+d) j n (2.7) it was shown that g'R’+d) _ e ib g id_ 

for the real exponential function one has e a+c = e a e c . Hence, it follows that 
e z+w = e a e c e ,b e' d = e a + ,b e c + ld — e z e w . This proves part a. For part b we 
use that | wz I = | w | | z I (see (2.4)). It then follows that | e x+iy | = | e x e ly | = 

| e x | | e' y | = e x since | e iy | = 1 for y e R and e x > 0 for x e R. In particular we 
see that | e x+iy | > 0 and so e z 0 for all z = x + iy e C. _ 

In contrast to the real exponential function e x (x e R), the complex function e z 
is by no means one-to-one. We recall, for example, that e 2n ' k — 1 for all k e Z (see 
(2.12)). Using theorem 11.1a it then follows that e z+27nk — e z for all k e Z and 

zeC. 

The definition of e z for z eC also enables us to extend the sine and cosine func¬ 
tions to complex functions. In (2.11) we already noted that sin y = ( e ,y — e~ ,y )/2i 
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DEFINITION 11.3 

Complex sine and cosine 


11.1 


11.2 

11.3 

11.4 

11.5 

Hyperbolic sine 
Hyperbolic cosine 


Unit disc 


and cosy = (e'- v + e ly )/2 for y e R. Since e ,z is now defined for z e C, this 
suggests the following definition. 

For z € C we define sin z and cos z by 

g iz _ e —iz giz _j_ g—iz 

sin z = -, cos z = -• 

2 i 2 

When z = y € R, these definitions are of course in accordance with the real 
sine and cosine. Many of the well-known trigonometric identities remain valid for 
the complex sine and cosine. For example, by expanding the squares it immediately 
follows that sin 2 z + cos 2 z = 1. Similarly one obtains for instance the formulas 
cos 2 z = cos 2 z — sin 2 z and sin 2z = 2 sin z cos z. However, not all results are the 
same! For example, it is not true that | sinz | < 1: for z = 2 i we have | sin2i | = 
(e 2 — e~-)/2 > 3. 

EXERCISES 

Determine the domain and range of the following complex functions: 

a /(z) = z, 

b /(z) = z\ _ 

c /(z)=z —4+f, 
d /(z) = (3f - 2)/(z + 3). 

Determine the real and imaginary part of the complex functions in exercise 11.1. 

Show that sin 2 z + cos 2 z = 1 and that sin 2z = 2 sin z cos z. 

Prove that sin(—z) = — sin z and that sin(z + vv) = sin z cos w + cos z sin w. 

For x G R the functions hyperbolic sine (sinh) and hyperbolic cosine (cosh) are 
defined by sinh.v = ( e x — e~ x )/2 and cosh* = (e x + e~ x )/2. 
a Prove that sin(iy) = i sinh y and cos(iy) = cosh y. 

b Use part a and exercise 11.4 to show that the real part of sin z equals sin x cosh y 
and that the imaginary part of sin z equals cos x sinh v. 


11.2 Continuity 

In this section the concept of continuity is treated for complex functions. Just as for 
real functions, continuity of a complex function will be defined in terms of limits. 
However, in order to talk about limits in C, we will first have to specify exactly what 
will be meant by ‘complex numbers lying close to each other’. To do so, we start 
this section with the notion of a neighbourhood of a complex number zo- 

In section 2.1.1 we noted that the set of complex numbers on the unit circle is 
given by the equation | z | = 1. The set of complex numbers inside the unit circle 
will be called the unit disc. The complex numbers in the unit disc are thus given 
by the inequality | z I < 1. In the same way all complex numbers inside the circle 
with centre 0 and radius <5 > 0 are given by the inequality \z\ < S. Finally, if 
we shift the centre to the point zq e C, then all complex numbers inside the circle 
with centre zq and radius <5 > 0 are given by the inequality | z — zq | < S. We call 
this a neighbourhood of the point zo- When the point zo itself is removed from a 
neighbourhood of zo, then we call this a reduced neighbourhood of zo; it is given by 
the inequalities 0 < | z — zq I < <5. See figure 11.3. We summarize these concepts 
in definition 11.4. 
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a b 



FIGURE 11.3 

A neighbourhood (a) and a reduced neighbourhood (b) of zq. 


DEFINITION 11.4 

Neighbourhood 


Reduced neighbourhood 


DEFINITION 11.5 

Limit in C 


DEFINITION 11.6 

Continuity in C 


Let S > 0. A neighbourhood of z o is defined as the set 

{ze<c| I z — z 0 1 < <5}. 

A reduced neighbourhood of zo is defined as the set 
|zecjo<|z-zol<i5j. 

Continuity of a complex function can now be defined precisely as for real func¬ 
tions. First the notion of a limit is introduced and subsequently continuity is defined 
in terms of limits. 

Let f be a complex function defined in a reduced neighbourhood of zo- Then 
linij-^jo f(z) = w means that for all e > 0 there exists a S > 0 such that for 
0 < | z — zo I <5 one has | /(z) — w | < e. 

Hence, the value /(z) is close to w when z is close to zq. Geometrically this 
means that the numbers /(z) will be lying in a disc which is centred around the 
point w and which is getting smaller and smaller as z tends to zo- 

Let f be a complex function defined in a neighbourhood ofz o G C. Then f is called 
continuous at zo t/linij-^Q /(z) = /(zo)- The function f is called continuous on 
a subset G in C when f is continuous at all points zo of G; this subset G should be 
a set such that every point zq G G has a neighbourhood belonging entirely to G. 

Foosely speaking: when / is continuous at zq, then the value /(z) is close to 
f(z o) when z is close to zo- The condition on the subset G in definition 11.6 is quite 
natural. This is because continuity at a point zo can only be defined if the function is 
defined in a neighbourhood of the point zo; hence, together with the point zo there 
should also be a neighbourhood of zo belonging entirely to G. This explains the 
condition on the set G. Definitions 11.5 and 11.6 are completely analogous to the 
definitions of limit and continuity in the real case. Considering this great similarity 
with the real case, a warning is justified. In the real case there are only two different 
directions from which a limit can be taken, namely from the right and from the left. 
Continuity at a point xq of a function / defined on R is thus equivalent to 
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11 Complex functions 


THEOREM 11.2 


THEOREM 11.3 


11.6 


11.7 


For a complex function the situation is completely different. The points z may 
approach zo in a completely arbitrary fashion in the complex plane, as long as 
the distance | z — zo I from z to zo decreases. Hence, for a complex function it is 
often much harder to prove continuity using definition 11.6. However, the rules 
for limits and continuity of complex functions are indeed precisely the same as for 
real functions. Using these rules it is in most cases easy to verify the continuity 
of complex functions. The proofs of the rules are also exactly the same as for real 
functions. This is why we state the following theorem without proof. 

Let f and g be complex functions defined in a reduced neighbourhood o/zq. If 
limj_>.T 0 /(z) = a and limj_>.T 0 g(z) = b, then 

lim (/(z) ± g(z)) = a ± b, 

Z^-Zo 

lim (/(z) ■ g(z)) = a ■ b, 
z^-zo 

lim ( f(z)/g(z )) = a/b if # 0. 

z^-zo 

If lim H ,_>. fl h(w) — c and if the function h is defined in a reduced neighbourhood of 
the point a, then lim-._ > 7 0 A(/(z)) = c. 

From theorem 11.2 one then obtains, as in the real case, the following results. 
Here the set G is as in definition 11.6. 

When f and g are continuous functions on a subset G of C, then f + g and f ■ g 
are continuous on G. Moreover, f/g is continuous on G, provided that g(z) Ofor 
all z e G. Ifh is a continuous function defined on the range of f, then (h o /)(z) = 
h(f(z )) is also a continuous function on G. 

As for real functions, theorem 11.3 is used to prove the continuity for ever more 
complicated functions. The constant function /(z) = c (c e C) and the function 
f(z) = z are certainly continuous on C (the proof is the same as for real functions). 
According to theorem 11.3, the product z ■ z = z 2 is then also continuous. Repeated 
application then establishes that z” is continuous on C for any n G N and hence 
also that any polynomial is continuous on C. By theorem 11.3 rational functions are 
then continuous as well, as long as the denominator is unequal to 0; in this case one 
has to take for the subset G the set C with the roots of the denominator removed 
(see section 2.1.2 for the concept of root or zero of a polynomial). Without proof 
we mention that such a set satisfies the conditions of definition 11.6. 

EXERCISES 

a Show that lim (/(z) + g(z)) = a + b if lim /(z) = a and lim g(z) = b. 

z—>zo z~^zo z~^zo 

b Use part a to prove that / + g is continuous on G if / and g are continuous on 
G (G is a subset of C as in definition 11.6). 

Use the definition to show that the following complex functions are continuous on 

€: 

a f (z) = c, where c e C is a constant, 
b /(z) = z. 

On which subset G of C is the following function continuous? 

3z — 4 

^ (z — l) 2 (z + 0(z — 20 


11.8 
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DEFINITION 11.7 

Differentiability in C 


DEFINITION 11.8 
Analytic function 

Derivative 


EXAMPLE 11.5 


EXAMPLE 11.6 


THEOREM 11.4 

THEOREM 11.5 
Linearity 


11.3 Differentiability 


Just as for continuity, the definition of differentiability of a complex function can be 
copied straight from the real case. 


Let f be a complex function defined in a neighbourhood ofzo e C. Then f is called 
differentiable at zq if 


lim 

z->-zo 


/(z) - /Up) 

Z - ZQ 


exists as a finite number. In this case the limit is denoted by /'(z o) or by (df/dz)(z o). 


When a complex function is differentiable for every zeC, then / is not called 
‘differentiable on C’, but analytic on C. The following definition is somewhat more 
general. 


Let f be a complex function, defined on a subset G of C. Then f is called analytic 
on G if f is differentiable at every point zo of G (here the subset G should again 
be a set as in definition 11.6). The function f' (now defined on G) is called the 
derivative of f. 


Although these definitions closely resemble the definitions of differentiability and 
derivative for real functions, there still is a major difference. Existence of the limit 
in definition 11.7 is much more demanding than in the real case; this is because the 
limit now has to exist no matter how z approaches zq. In the real case there are 
only two possible directions, namely from the right or front the left. In the complex 
case there is much more freedom, since only the distance | z — zo I from z to zq 
has to decrease and nothing else is assumed about directions (compare this with the 
remarks following definition 11.6). Yet, here we will again see that for the calcula¬ 
tion of derivatives of complex functions one has precisely the same rules as for real 
functions (see theorem 11.5). As soon as we have calculated a number of standard 
derivatives, these rules enable us to determine the derivative of more complicated 
functions. In the following examples we use definition 11.7 to determine our first 
two standard derivatives. 


Consider the constant function f(z) — c, where c e C. Let zo e C. Since f(z) — 
f (zo) = c — c = 0 for each z e C, it follows that f'(zo) = 0. As for real constants 
we thus have that the derivative of a constant equals 0. Put differently, the function 
f(z) = c is analytic on C and f'(z) = 0. ^ 

The function /(z) = z is analytic on C and has as its derivative the function 1. In 
fact, for z 0 e C one has f(z) - /(z 0 ) = z - zo and so (/(z) - f(z o))/(z - zo) = 1 
for each z e C. This shows that /'(zo) = 1 for each zq e C. + 

Quite a few of the well-known results for the differentiation of real functions 
remain valid for complex functions. The proofs of the following two theorems are 
exactly the same as for the real case and are therefore omitted. 

Let f be a complex function and assume that /'(zo) exists at the point zo- Then f 
is continuous at zq. 

Let f and g be analytic on a subset G of C (G as in definition 11.6). Then the 
following properties hold: 

a af + bg is analytic on G for arbitrary a, b e C and (af + bg) f (z) = af'(z) + 
bg'(z); 

b f ■ g is analytic on G and the product rule holds: (/ • g)'(z) = f'(z)g(z) + 
/(z)g'(z); 


Product rule 
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Quotient rule 


Chain rule 


c if g(z) 7 ^ 0 for all z e G, then f/g is analytic on G and the quotient rule holds: 

/A' /'(z)g(z) - f(z)gfz) 

UJ— W &— : 

d ifh is analytic on the range f(G) ofG under f, then the function {h o f){z) = 
h(f(z)) is analytic on G and the chain rule holds: (h o f)'(z) = h'{f(z))f'(z)- 

Using theorem 11.5 and examples 11.5 and 11.6 one can determine the derivative 
of any polynomial and any rational function. As a first step we calculate the deriva¬ 
tive of z 2 using theorem 11.5b and example 11.6: ( z) = (z ■ z) 1 = zz' + z'z 
■ = 2 z. By arepeated application of this rule it then follows that ( z n Y = nz"~ l , 

just as in the real case. If we now use theorem 11.5a, it follows that any poly¬ 
nomial a n z n + a n - iz ” -1 + • • • + aiz + «o is analytic on C and has derivative 
na n z n ~ 1 + (n — l)a n _\z n ~~ + ■ ■ ■ + a\. Subsequently one can apply the quotient 
rule from theorem 11.5c to conclude that a rational function is analytic on C if we 
remove the points where the denominator is equal to zero. 

The real exponential function e x has as its derivative the function e x again. We 
will now show that the complex function e z is analytic on C and has as its deriva¬ 
tive the function e z again. This gives us an important new standard derivative and 
although this result will probably come as no surprise, its proof will require quite an 
effort. 

As a preparation we will first consider certain limits of functions of two real 
variables x and y. Let us consider, for example, the limit 

r > ’ 3 

ft,y)—>(0,0) X 2 + y 2 

Here (x, y) —>■ (0, 0) means that the distance from (x, y) e R 2 to the point (0, 0) 
keeps decreasing, that is to say, x 2 + y 2 —> 0 (if we write z = x + iy, then this 
means precisely that | z | —»■ 0). Now introduce polar coordinates, so x = r cos <f> 
and y = r sin <j> (this means precisely that z = r cos (j> + ir sin f — re'^, the well- 
known expression (2.6)). We then have x 2 + y 2 = r 2 and hence 

y 3 r 2 sin 3 f 3 

lim — 3 —- - = lim -^- = lim r sin <p. 

U,y)^(0,0) X 2 + y 2 r—>-0 r~ r—^-0 

Since | sin 3 <j> | < 1, it follows that 

y 3 

lim - w = 0 . 

(x,y)->( 0 , 0 ) x 2 + y 2 

The same method can be applied to the quotient x 2 /{x 2 + y 2 ) or xy 2 /(x 2 + y 2 ). In 
general one has for k, l e N that 

x k y l 

lim —^—=0 if+ / > 3. (11.2) 

(*,y)->-( 0 , 0 ) x 2 + y 2 

In fact, by changing to polar coordinates it follows that 


x^yi r £+/ cos A- ^ s j n ( ^ 

lim T = lim -^- 

(x,y)—s-(0,0) X 2 + y 2 r->0 r 2 


lim r k+l 2 cos* f sin ? <f> = 0, 
r-> 0 


since k + l — 2 > 1 and j cos* <p sin ; <j> j < 1. We use (11.2) in the proof of the 
following theorem. 
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The function e z is analytic on C and 

(e z Y = e z . (11.3) 

Proof 

Take ze C arbitrary, then 

e w — e z e z (e w ~ z — 1) 7 e w ~ z - 1 

lim - = ltm - = e' ltm -, 

w->z w — z W->-Z w — Z w—z—>0 >v — z 

where we used the important property in theorem 11.1a. If we now show that 
lim (( _ s> o(T M — 1 )/u = 1 for arbitrary u e C, then it follows that e z is differentiable 
at every point ze C and that the derivative at that point equals e z . The function e z 
is then analytic on C and (e z Y = e z . 

In order to show that indeed lim w ^o( eW — 1)/“ — 1 , we note that for m =x + iy 

e“ - 1 e x (cos y + i sin y) — 1 ((e x cos y - 1) + ie x sin y) (x - iy) 
u x + iy (x + iy)(x — iy) 

Now expand numerator and denominator and note that u —> 0 is equivalent to 
(x, y) -¥ (0, 0). It then follows that lim H _ ) .o(e“ — 1 )/u = 1 equals 

( xe x cos y — x + e x y siny) + i(xe x sin y — e x y cos y + y) 

hm -'----y---'- 

(r,y)— »(0,0) X 2 + y 2 

x(e x cosy — I ) + e x y siny 

= ltm -y-y- 

(x,y)—?(0,0) x 2 + y 2 

xe x sin y + y(l — e x cosy) 

+ i lim -- —f -y-—. 

(r,y)— >(0,0) X 2 + y 2 

These two limits are now calculated separately by applying (11.2). To this end we 
develop the functions e x , sin v and cos y in Taylor series around the point x = 0 and 
y = 0 respectively (see (2.23) - (2.25)): 

e x = 1 T x T x 2 /2 + • • •, 
sin y = y — y 3 /6 + • • • , 
cosy = 1 — y 2 /2 + • • •. 

We now concentrate ourselves on the first limit. From the Taylor series it follows 
that 

e x cosy-1 = -1 + (1 +x + x 2 /2-\ -)(l-y 2 /2q -) 

= — 1 + 1 — y 2 /2 + v + v 2 /2 + • • • , 

from which we see that 

e x cos y — 1 = x + terms of the form x^y 1 with k + l >2. 

In the same way we obtain 

e x sin y = (1 +jM -)(y — - - -) 

= y + terms of the form x^y 1 with k + l >2. 
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11.9 

11.10 

11.11 


For the first limit it then follows that 

x(e x cosy — 1) + e x y siny 

hm ----- 

U',y)^(0,0) X 2 + y 2 

x~ + v 2 + terms of the form x k y k with k + l > 3 

= hm ---~- ~ --- 

(*,y)-K0,0) x 2 + y 2 

terms of the form x k y 1 with k + 1 > 3 

= lim 1H- ■= - —= - = 1, 

(,v,y)—>(0,0) x 2 + y 2 

where we used (11.2) in the final step. The second limit is treated in the same way 

1 — e x cos y = — x + terms of the form x k y l with k + l > 2, 

and, with the expression for e x sin y as before, we thus find that 

xe x sin y + y (1 — e x cos y) 

— x y ~ y x + terms of the form x k y* with k +1 > 3. 

Hence, the numerator in the second limit only contains terms of the form x k y^ 
k + 1 > 3, since xy — yx — 0. From (11.2) it then follows that the second 
equals 0. This proves that lim„_ s .o(e u — 1 )/u — 1. 

From theorem 11.6 (and theorem 11.5) it also follows that the functions sin z and 
cos z are analytic on C. This is because sinz = (e ,z — e~ ,z )/2i and cos z = (e' z + 
e~ lz )/2 and from the chain rule it then follows that (sinz/ = ( ie lz + ie~ ,z )/2i = 
cos z and similarly (cos z)' = — sin z. 

We close this section with an example of a complex function which is not differ¬ 
entiable. 


with 

limit 


Consider the function /(z) = z from example 11.1. We will show that / is not 
differentiable at z = 0, in other words, that the limit 


lim 

z^0 


f(z) - /(0) 
z — 0 


lim - 

z^O z 


from definition 11.7 does not exist. First we take z = x with x e R; then z — x and 
so lim r _j.o z/z = lim A ^o x/x = 1. Next we take z = iy with y el; then z = — iy 
and so lim= lim-y^o(—*y)/*y — — 1. This shows that the limit does not 
exist. ^ 


EXERCISES 

Use definition 11.7 to prove that the function /(z) = z 2 is analytic on C and deter¬ 
mine its derivative. 


Let / and g be analytic on the subset G of C. Show that / + g is analytic on G and 
that (/ + g/(z) = f'{z) + g\z ). 

Determine on which subset of C the following functions are analytic and give their 
derivative: 

a f (z) = (z l) 4 , 
b /(z) = z + 1/z, 
c /(z) = (z 2 - 3z + 2 )/(z 3 + 1), 
d /(z) = e r + 1. 


11.12 


Show that (cos z)' = — sin z. 
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11.13 


THEOREM 11.7 


We have seen that many of the rules for complex functions are precisely the same 
as for real functions. That not all rules remain the same is shown by the following 
Bernoulli paradox'. 1 = = V( — 1 )(— 1 ) = •/(— TT^/(— 1 ) = i ■ i = i 2 = — 1 . 

Which step in this argument is apparently not allowed? 


11.4 The Cauchy-Riemann equations* 


The material in this section will not be used in the remainder of the book and can 
thus be omitted without any consequences. 

The proof of theorem 11.6 clearly shows that in some cases it may not be easy 
to show whether or not a function is differentiable and, in case of differentiability, 
to determine the derivative. The reason for this is the fact, mentioned earlier, that 
a limit in C is of a quite different nature from a limit in R. In order to illustrate 
this once more, we close with a theorem whose proof cleverly uses the fact that a 
limit in C should not depend on the way in which z approaches zo in the expression 
lim;_> Zo . The theorem also provides us with a quick and easy way to show that a 
function is not analytic. 


Let /(z) = u (x , y) + iv(x, y) be a complex function. Assume that f'izo ) exists at 
a point zq = xq + iy o- Then 3 u/dx, du/dy, dv/dx and dv/dy exist at the point 
(x 0 , yq) an d tit (xq, yo) one has 


dll 

dv 

and 

du 

dv 

- — 


- — 


dx 

dy 


3y 

dx 


(11.4) 


Proof 

In the proof we first let z = x + iy tend to = xq + iyq in the real direction 
and subsequently in the imaginary direction. See figure 11.4. It is given that the 



FIGURE 11.4 

The limit in the real and in the imaginary direction. 


following limit exists: 


f'izo ) 


lim 

z^-zo 


fiz ) - fizo) 
z-zo 


We first study the limit in the real direction. We thus take z = x + iyo, which means 
that z — >■ zq is equivalent to x -*■ xq since z — zq = x + iyo — xq — iyo — x — xq. 
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EXAMPLE 


Moreover, we then have 


f'(zo) 


lim 

Z^-ZO 


m - fiz o) 

Z-Z o 


u(x,y 0 ) + iv(x,y 0 )-u(x 0 ,y 0 ) 
hm - 

X^XQ X — XQ 


iv(x 0 , y 0 ) 


u(x, yo) - «(*o. yo) 

lim - 

*-►*0 x — ^0 


+ i lim 

X^XQ 


v(x, y 0 ) - v(.*q, y 0 ) 

X — XQ 


Since f'(zo ) exists, both limits in this final expression have to exist as well. But 
these limits are precisely the partial derivatives du/dx and dv/dx at the point (xp, yo), 
which we denote by (du/dx)(xQ, Vq) and (3v/3.r)(.vo, yo)- Hence, 

, du 3v 

/ (zo) = ^-(*o> yo) + o- yo)- 

dx dx 

Next we study the limit in the imaginary direction. We thus take z = A'q + iy, which 
means that z —v zq is equivalent to y —v yo since z — zo = xo + iy — xq — iV'o = 
i (y — yo). As before, it then follows that 


/'(Z0) 


Hence, 


lim upc Q, v) + tv(jf 0 , y) - u(x 0 , y 0 ) - tv(jr 0 , vp) 
y^yo i(y-yo) 

1 m(jc 0 , y) - «(JC 0 , y 0 ) , v(v 0 , y) - v(v 0 , y Q ) 

- lim-1- hm - 

i y^yo y - yo y^-yo y - yo 


, 3v 3i< 

/ (zo) = 7-(*0> yo) - i-x-(x o, yo). 
3y 3y 


From these two expressions for f'(zo) it follows that at the point (vo, yo) we have 
du . 3v 3v .du 
dx dx dy dy ' 

If we compare the real and imaginary parts in this identity, then we see that indeed 
du/dx = 3v/3y and du/dy = —dv/dx at the point (vq, yo)- ■ 


The equations du/dx = 3v/3y and du/dy = —dv/dx from (11.4) are called the 
Cauchy-Riemann equations. They show that for an analytic function the real part 
u{x, y) and the imaginary part v(.v, y) have a very special relationship. One can 
thus use theorem 11.7 to show in a very simple way that a function is not analytic. 
Indeed, when the real and imaginary part of a complex function / do not satisfy the 
Cauchy-Riemann equations front theorem 11.7, then / is not analytic. 

Consider the function f(z) — z■ The real part is u(x, y) = x, while the imaginary 
part is given by v(x, y) = —y. Hence du/dx — 1 and 3v/3y = —1. Since the 
Cauchy-Riemann equations are not satisfied, it follows that / is not analytic on C 
(see also example 11.7). ^ 

Even more important than theorem 11.7 is its converse, which we will state with¬ 
out proof: when du/dx, du/dy, dv/dx and 3v/3y exist and are continuous on a 
subset G of C and when they satisfy the Cauchy-Riemann equations (11.4) on G, 
then f(z) — u(x, y) + iv(x, y) (z = x + iy) is analytic on G. This gives us a very 
simple method to show that a function is analytic! 

For the function f(z) = e z one has u(x, y) = e x cosy and v(x, y) = e x siny. It 
then follows that du/dx — e^cosy, du/dy = — e x siny, dv/dx = e* siny and 
dv/dy = e-'-cosy. The partial derivatives thus exist and they are continuous onR 2 . 


EXAMPLE 
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11.14* 

11.15* 


11.16 

11.17 


Moreover, they satisfy the Cauchy-Riemann equations. Hence, the function e z is 
analytic onC and f'{z) = 3 u/dx + idv/dx = e x cosy + ie x sin y = e z . Compare 
the ease of these arguments with the proof of theorem 11.6. ^ 

EXERCISES 

We know that the function f(z) = z~ is analytic on C (see exercise 11.9 or the text 
following theorem 11.5). Verify the Cauchy-Riemann equations for / (see example 
11.4 for the real and imaginary part of /). 

Use the Cauchy-Riemann equations (and the results of example 11.3) to show that 
/(z) = 1 /z is analytic on C — (0). 


SUMMARY 


Complex functions are functions from (a subset of) C to C. By identifying C with 
R 2 , one can split a complex function into a real part and an imaginary part; these are 
then functions from R 2 to R. A very important complex function is e z = e x+iy = 
e x (cos y + i siny). It has the characteristic property e z+w = e z e w for all w, z e 
C. Using e z one can extend the sine and cosine functions from real to complex 
functions. 

Continuity and differentiability of a complex function / can be defined by means 
of limits, just as for the real case: / is called continuous at zo e C when 
linij-^jQ f{z) = f (zq ); / is called differentiable when 


lim 

z->-zo 


fU) - /Up) 
z-zo 


exists as a finite number. A complex function f is called analytic on a subset G 
of C when / is differentiable at every point of G. The well-known rules from real 
analysis remain valid for the complex functions treated here. The function e z , for 
example, is analytic on C and has as derivative the function e z again. 


SELFTEST 

Consider the complex function f(z) = cos z. 

a Is it true that | cos z I < 1? If so, give a proof. If not, give a counter-example, 
b Show that cos(w + z) = cos w cos z — sin w sin z. 
c Determine the real and imaginary part of cos z. 

d Give the largest subset of C on which / is analytic. lustify your answer. 

Determine on which subset G of C the following functions are analytic and give 
their derivative: 

a (z 3 + l)/(z - 1), 
b 1/(z 4 T 16) 1 °, 
c e z /(z 2 + 3), 
d sinfe 2 ). 
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CHAPTER 12 


The Laplace transform: definition and 
properties 


INTRODUCTION 


Signals occurring in practice will always have been switched on at a certain moment 
in time. Choosing this switch-on moment equal to t = 0, we are then dealing with 
functions that are zero for t < 0. If, moreover, such a function is multiplied by a 
damping factor e~ at (a > 0). then it is not unreasonable to expect that the Fourier 
transform of e~ at f(t) will exist. As we have seen in the introduction to part 4, this 
leads to a new transformation, the so-called Laplace transform. In section 12.1 the 
Laplace transform F{s) of a causal function f(t) will be defined by 

r 00 

F(s)= / f{t)e~ s, dt. 

Jo 

Here s e C is ‘arbitrary’ and F(s) thus becomes a complex function. One of the 
major advantages of the Laplace transform is the fact that the integral is convergent 
for ‘a lot of’ functions (which is in contrast to the Fourier transform). For example, 
the Laplace transform of the unit step function exists, while this is not the case for 
the Fourier transform. 

In section 12.1 we consider in detail the conditions under which the Laplace 
transform of a function exists. This is illustrated by a number of standard examples 
of Laplace transforms. Because of the close connection with the Fourier transform, 
it will hardly be a surprise that for the Laplace transform similar properties hold. 
A number of elementary properties are treated in section 12.2: linearity, rules for a 
shift in the time domain as well as in the s -domain, and the rule for scaling. 

In section 12.3 the differentiation and integration rules are treated. These are 
harder to prove, but of great importance in applications. In particular, the rule for 
differentiation in the time domain proves essential for the application to differential 
equations in chapter 14. The differentiation rule in the .s-domain will in particu¬ 
lar show that the Laplace transform F(s) of a causal function f(t) is an analytic 
function on a certain subset of C. 

LEARNING OBIECTIVES 

After studying this chapter it is expected that you 

- know and can apply the definition of the Laplace transform 

- know the concepts of abscissa of convergence and of absolute convergence 

- know the concept of exponential order 

- know and can apply the standard examples of Laplace transforms 

- know and can apply the properties of linearity, shifting and scaling 

- know and can apply the rules for differentiation and integration. 
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DEFINITION 12.1 

Laplace transform 


Laplace transform 
s-domain 


DEFINITION 12.2 
Absolutely convergent 


12.1 Definition and existence of the Laplace transform 


The following definition has been justified in the introduction (and in the introduc¬ 
tion to part 4). For the notion ‘causal function' or ‘causal signal’ we refer to section 


1.2.4. 


Let fit ) be a causal function, so f(t) = 0 for t < 0. The Laplace transform F(s) 
°f fit) is the complex function defined for s e C by 

fOO 

F(s)= / f(t)e~ s, dt, (12.1) 

Jo 

provided the integral exists. 

We will see in a moment that for many functions /(f) the Laplace transform F(s) 
exists (on a certain subset of C). The mapping assigning the Laplace transform F(s) 
to a function /(f) in the time domain will also be called the Laplace transform. 
Furthermore, we will say that F(s) is defined in the s-domain; one sometimes calls 
this 5-domain the ‘complex frequency domain' (although a physical interpretation 
can hardly be given for arbitrary s e C). Besides the notation F(s) we will also 
use (Cf){s), so ( Cf){s ) = F{s). Often the notation ( Cf(t))(s ), although not very 
elegant, will be useful in the case of a concrete function. 

In this part of the book we will always tacitly assume that the functions are causal. 
The function f, for example, will in this part always stand for e(f)f; it is equal to 
0 for f < 0 and equal to f for f > 0. In particular, the constant function 1 is 
equal to e(t) in this part. Moreover, for all functions it will always be assumed 
that they are piecewise smooth (see definition 2.4). In particular it then follows that 
/cf /(0e _ ' sf dt will certainly exist for any R > 0. The existence of the integral in 
(12.1) then boils down to the fact that the improper Riemann integral over R, that 
is, lim^^oo f« f(t)e~ sl dt, has to exist. 

Note also that for s = a + ico with a, a> e R it immediately follows from the 
definition of the complex exponential that 

/■OO 

F)s)= f(t)e~ at e~ ia>t dt. (12.2) 

Jo 

This is an interesting formula, for it shows that the Laplace transform F(s) of /(f) 
at the points- = a + ico is equal to the Fourier transform of e(t) f (t)e~ at at the point 
to, provided all the integrals exist. This is the case, for example, if e(t)f(t)e~ al is 
absolutely integrable (see definition 6.2). For the moment, we leave this connection 
between the Laplace and Fourier transform for what it is, and return to the question 
of the existence of the integral in (12.1), in other words, the existence of the Laplace 
transform. As far as the general theory is concerned, we will confine ourselves to 
absolute convergence. 

An integral g(t) dt with —oo < a < b < oo is called absolutely convergent if 



I git) I dt < oo. 


This concept is entirely analogous to the concept of absolute convergence for 
series (see section 2.4.2). Since | / g{t)dt | < / | g(1) \ dt (as in (2.22)), we see 
that an absolutely convergent integral is also convergent in the ordinary sense. The 
converse, however, need not to be true, just as for series. Note that for the absolute 
convergence of the integral in (12.1) only the value of o = Re 5 is of importance, 
since \e ,(ot \ — 1 for all a> e R. In the general theory we will confine ourselves to 
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EXAMPLE 12.1 
Laplace transform of 1 


EXAMPLE 12.2 
Laplace transform of e at 


absolute convergence, since proofs are easier than for the case of ordinary conver¬ 
gence. For concrete cases it is usually quite easy to treat ordinary convergence as 
well. To get some feeling for the absolute and ordinary convergence of the integral 
in (12.1), we will first treat two examples. 


Let e(t) be the unit step function. The Laplace transform of e(t) (or the function 1) 
is given by the integral 



lim [ R e- a, e - iwt dt 
R^oo Jo 


if s = o + ito. We first consider absolute convergence. The absolute value of the 
integrand is equal to e~ at and for of: 0 one has 


r R 

--e~ at 

1 e at dt = 

Jo 

o 




The integral thus converges absolutely if lim^^oo e~ aR exists and of course this 
is the case only for a > 0. Hence, the Laplace transform of elf) certainly exists 
for a > 0, so for Re s > 0. We will now show that the integral also converges in 
the ordinary sense precisely for all s e C with Re .y > 0. For s = 0 we have that 
lim^-^oo f R 1 dt does not exist. Since (e~ st )' = —se~ st (here we differentiate 
with respect to the real variable t ; see example 2.11), it follows for s f 0 that 


rR 

r i sti 

-~e sr 

1 e 51 dt = 

Jo 

s 


Hence, the Laplace transform of eft) will only exist when lim^^^ = 

lim^-^oo e~ aR e~ i(oR exists. Since \e~ ia>R \ — 1, the limit will exist precisely 
for a > 0 and in this case the limit will of course be 0 since lim^^oo e~ aR = 0 for 
a > 0. We conclude that the integral converges in the ordinary sense precisely for 
all s e C with Re s > 0 and that the Laplace transform of 1 (or e(t)) is given by 1 /s 
for these values of s. Note that in this example the regions of absolute and ordinary 
convergence are the same. ^ 


Let ael. The Laplace transform of the function e at (hence of e(t)e at ) is given by 


poo 

I „at —st 
I e e 

Jo 


dt 


.in, f R e - (n - a)t e- iwt dt 

R^oo Jq 


if s = o + ico. Again we first look at absolute convergence. The absolute value of 
the integrand is e _ ( or_ °) r and for a f a one has 


[ R e- (c ~ a)t dt = —— (l _ e -(o-c)R\ 
Jo o - a \ / 


Hence, the integral converges absolutely when lim/j^^ e ~( a ~ a ) R exists and this is 
precisely the case when a — a > 0, or Re s > a. We will now determine the Laplace 
transform of e at and moreover show that the integral also converges in the ordinary 
sense for precisely all s e C with Re s > a. For s = a the Laplace transform will 
certainly not exist. Since (e~^ s ~ a ^ r ) f = — (s — a)e ~^ s ~ a ^ t , it follows for s f a that 



dt 


i n i 

R—>o o 



R 


( s—a)t 


0 


1 


s — a 


1 

- lim 

s — a R—>oo 


g -(s-a)R 


As in example 12.1, we have lim^-^ooe ^ a ^ R = lim^-^oo e a ^ R e la>R = 0 
precisely when a — a > 0. Hence, there is ordinary convergence for Re s > a and 
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the Laplace transform of e at is given by I / (s — a) for these values of s. For a = 0 
we recover the results of example 12.1 again. ^ 


It is not hard to prove the following general result on the absolute convergence of 
the integral in definition 12.1. 

Let f(t ) be a causal function and consider the integral in (12.1). 
a If the integral is absolutely convergent for a certain value s = op e R, then the 
integral is absolutely convergent for all s G C with Re s > oq. 
b If the integral is not absolutely convergent for a certain value s = oq el, then 
the integral is not absolutely convergent for all s e C with Re s < oq. 


Proof 

We first prove part a. Write s = o + ico. Since | e imt | = 1 and e~ at > 0, it follows 
from 12.2 that 


f 


I f(t)e- 


dt = 


f 


I /« I e~ at dt. 


For Re 5 = a > ctq one has that e ot < e ° ot for all t > 0. Hence, 

POO P CO 

/ \f(t)e~ s, \dt< / I fit) I e~ aot dt. 

Jo Jo 

According to the statement in part a, the integral in the right-hand side of this in¬ 
equality exists (as a finite number). The integral in (12.1) is thus indeed absolutely 
convergent for all j e C with Re s > (Tq- This proves part a. 

Part b immediately follows from part a. Let us assume that there exists anij 6 C 
with Re s < o\ such that the integral is absolutely convergent after all. According 
to part a, the integral will then be absolutely convergent for all j e C with Re s > 
Re .sq- But Reoq = a \ > Re.sq and hence the integral should in particular be 
absolutely convergent for ,v = a\ . This contradicts the statement in part b. g 


From theorem 12.1 we see that for the absolute convergence only the value 
Re s = o matters. Note that the set {s e C | Re s = a ) is a straight line per¬ 
pendicular to the real axis. See figure 12.1. 

Using theorem 12.1 one can, moreover, show that there are precisely three possi¬ 
bilities regarding the absolute convergence of the integral in (12.1): 

a the integral is absolutely convergent for all seC; 
b the integral is absolutely convergent for nos 6 C whatsoever; 



FIGURE 12.1 

The straight line Re s = a (for a a > 0). 
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THEOREM 12.2 


Abscissa of absolute 
convergence 


c there exists a number tr a el such that the integral is absolutely convergent for 
Re s > o a and not absolutely convergent for Re s < o a . 

In case c there is no statement about the absolute convergence for Re s = o a . It is 
possible that there is absolute convergence on the line Re s = cr a , but it is equally 
possible that there is no absolute convergence. In example 12.1 we have seen that 
o a = 0; in this case there is no absolute convergence for Re s = o a = 0. 

Strictly speaking, we have not given a proof that these three possibilities are the 
only ones. Intuitively, however, this seems quite obvious. Suppose that possibilities 
a and b do not occur. We then have to show that only possibility c can occur. Now 
if a does not hold, then there exists aff( el such that the integral is not absolutely 
convergent (we may assume that oq is real, since only the real part is relevant for 
the absolute convergence). According to theorem 12.1b, the integral is then also not 
absolutely convergent for all s e C with Re s < oq . Since also b does not hold, 
there similarly exists a oq G ® such that the integral is absolutely convergent for all 
s e C with Res > fro (we now use theorem 12.1a). In the region oq < Res < oq, 
where nothing yet is known about the absolute convergence, we now choose an 
arbitrary oq e R. See figure 12.2. If we have absolute convergence for oq, then we 


i 
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no 
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convergence 
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1 

1 

1 
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FIGURE 12.2 

Regions of absolute convergence. 

can extend the region of absolute convergence to Re s > 03 . If there is no absolute 
convergence, then we can extend the region where there is no absolute convergence 
to Res < oq. This process can be continued indefinitely and our intuition tells us 
that at some point the two regions will have to meet, in other words, that possibility 
c will occur. That this will indeed happen rests upon a fundamental property of the 
real numbers which we will not go into any further. The above is summarized in the 
following theorem. 

For a given causal function fit) there exists a number oq e R with —00 < oq < 
00 such that the integral f£° f(t)e~ sr dt is absolutely convergent for all s e C 
with Res > oq, and not absolutely convergent for all s e C with Res < oq. By 
oq = —00 we will mean that the integral is absolutely convergent for all s e C. 
By oq = 00 we will mean that the integral is absolutely convergent for no s E C 
whatsoever. 

The number o a in theorem 12.2 is called the abscissa of absolute convergence. 
The region of absolute convergence is a half-plane Res > o a in the complex plane. 
See figure 12.3. The case o a = 00 (possibility b) almost never occurs in practice. 
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Re s > c a 
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DEFINITION 12.3 
Exponential order 

EXAMPLE 12.3 

EXAMPLE 

EXAMPLE 12.4 

THEOREM 12.3 


FIGURE 12.3 

The half-plane Re s > cr a of absolute convergence. 

This is because functions occurring in practice are almost always of ‘exponential 
order’. 

The causal function / :!->€« called of exponential order if there are constants 
ael and M > 0 such that \ f(t)\ < Me at for all t > 0. 

Functions of exponential order will not assume very large values too quickly. The 
number a in definition 12.3 is by no means unique, since for any f) > a one has 
e 01 ' < eP' for t > 0. 

The unit step function e(t) is of exponential order with M — 1 and a = 0 since 

|e(0 | < 1. M 

Let f(t) be a bounded function, so | f(t) \ < M for some M > 0. Then / is of 
exponential order with a = 0. The function e(t) is a special case and has M = 1.^ 

Consider the function f(t) = t. From the well-known limit lim^oo te~ al = 0, 
for a > 0, it follows that | f(t) \ < Me 01 ’ for any a > 0 and some constant M > 0. 
Hence, this function is of exponential order with a > 0 arbitrary. However, one 
cannot claim that / is of exponential order with a = 0, since it is not true that 
\t\<M. M 

We now recall example 12.2, where it was shown that the Laplace transform of 
e a< exists for Res > a. The following result will now come as no surprise. 

Let f be a function of exponential order as in definition 12.3. Then the integral in 
(12.1) is absolutely convergent (and so the Laplace transform of f will certainly 
exist) for Res > a. In particular one has for the abscissa of absolute convergence 
cr a that cr a < a. 

Proof 

Since \ f(t)\ < Me at for all t > 0, it follows that 



where s = a + ico. As in example 12.2 it follows that the latter integral exists for 
a — a > 0, so for Re s > a. Finally, we then have for a a that cr a < a. For if a a > a, 
then there will certainly exist a number f) with a < f < o a . On the one hand it 
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EXAMPLE 12.3 

EXAMPLE 

EXAMPLE 12.4 

THEOREM 12.3 





12.1 The Laplace transform: definition and existence 


273 


EXAMPLE 


EXAMPLE 12.5 


Abscissa of convergence 


EXAMPLE 12.6 

EXAMPLE 12.7 


would then follow from f) < <r a and the definition of c a that the integral does not 
converge absolutely for s = f, while on the other hand f > a would imply that 
there is absolute convergence. g 

The unit step function e(t) is of exponential order with a = 0. From theorem 12.3 it 
follows that the Laplace transform will certainly exist for Re s > 0 and that c a < 0. 
As was shown in example 12.1, we even have cr a = 0. ^ 

In example 12.4 it was shown that the function t is of exponential order for arbitrary 
a > 0. From theorem 12.3 it then follows that the Laplace transform of t certainly 
exists for Re s >0 and that cr a < 0. In example 12.9 we will see that cr a = 0. ^ 

In the preceding general discussion of convergence issues, we have confined our¬ 
selves to absolute convergence, since the treatment of this type of convergence is 
relatively easy. Of course one can wonder whether similar results as in theorem 
12.3 can also be derived for ordinary convergence. This is indeed the case, but these 
results are much harder to prove. We will merely state without proof that there 
exists a number cr c , the so-called abscissa of convergence, such that the integral 
Jo f(t)e~ sl dt converges for Res > o c and does not converge for Res < o c . 
Since absolute convergence certainly implies ordinary convergence, we see that 
o c — °a- In most concrete examples one can easily obtain o c . 

In example 12.1 it was shown that the Laplace transform of e(t) exists precisely 
when Res >0. Hence, in this case we have cr a = cr c = 0. ^ 

The shifted unit step function e(t — b ) in figure 12.4 is defined by 

for t > b, 
for t < b. 

The Laplace transform of e{t — b) can be determined as in 



FIGURE 12.4 

The shifted unit step function e(t — b) with b > 0. 


e(t - b) = 
where b > 0 . 


example 12.1. For s = 0 the Laplace transform does not exist, while for s ^ 0 
it follows that 


r 

JO 


e st e(t — b) dt — 


r 

Jb 


e~ sl dt = lim 
R—>o o 


—e 
s 


Jb 


e~ bs 1 

-lim e 

s s R— MX) 


-sR 


Again the limit exists precisely for Re s > 0 and it equals 0 then. Here we again 
have < 7 a = cr c = 0. Furthermore, we see that for Re s > 0 the Laplace transform of 
e(t — b) is given by e~ bs /s. ^ 
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EXAMPLE 12.8 

EXAMPLE 12.9 


Two-sided Laplace transform 


From example 12.2 it follows that for the function e br we have that o a = o c = b. 
For Res > b the Laplace transform is given by 1 /(s — b). ^ 


We now determine the Laplace transform of the function f(t ) = t. For s = 0 the 
Laplace transform does not exist, while for s 0 it follows from integration by 
parts that (from example 12.5 we know that o a < 0): 


F(s) 




--( e~ st )'dt 


lim 

R—>oo 





dt 


-lim Re 

S R 

1 


-sR 


+ lim 

R—roc 

1 


=-lim Re sR -^ 


S R—fO o 


s z R 


■s- JO 

lim e~ sR + 
oo s z 


As before, one has for Re s = rr >0 that lims^oo e sR = 0. Since for a >0 we 
have lim^^oo Re~ aR = 0 as well, it also follows that lim^^oo Re~ sR = 0 for 
Res > 0. This shows that F(s) — 1/s 2 for Re s > 0. We also see that the limits do 
not exist if Re s < 0; hence, cr a = cr c = 0. ^ 


The previous example is a prototype of the kind of calculations that are usually 
necessary in order to calculate the Laplace transform of a function: performing an 
integration by parts (sometimes more than once) and determining limits. These 
limits will in general only exist under certain conditions on Res. Usually this will 
also immediately give us the abscissa of convergence, as well as the abscissa of 
absolute convergence. In all the examples we have seen so far, we had cr a = a c . In 
general, this is certainly not the case; for example, for the function e' sin(e f ) one 
has tr a = 1 while cr c = 0 (the proof of these facts will be omitted). There are even 
examples (which are not very easy) of functions for which the integral in (12.1) 
converges for all s e C (so o c = —oo), but converges absolutely for nos e C 
whatsoever (so c a = oo)! As a matter of fact, for the application of the Laplace 
transform it almost always suffices to know that some half-plane of convergence 
exists; the precise value of <r a or cr c is in many cases less important. 

We close this section by noting that besides the Laplace transform from definition 
12.1, there also exists a so-called two-sided Laplace transform. For functions on R 
that are not necessarily causal, this two-sided Laplace transform is defined by 



f(t)e~ s, dt , 


for those s e C for which the integral exists. Since in most applications it is as¬ 
sumed that the functions involved are causal, we have limited ourselves to the ‘one¬ 
sided’ Laplace transform from definition 12.1. Indeed, the one-sided and two-sided 
Laplace transforms coincide for causal functions. Also note that 

/ OO r OO n OO 

f(t)e~ st dt = / f(t)e~ s, dt+ / f(—t)e~^~ s ^ r dt. 

-oo JO Jo 

Hence, the two-sided Laplace transform of f(t) is equal to the (one-sided) Laplace 
transform of /(f) plus the (one-sided) Laplace transform at —s of the function 
/(— t). There is thus a close relationship between the two forms of the Laplace 
transform. 
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Linearity of C 


EXERCISES 

12.1 a Indicate why the limit lim^^oo e~ imR does not exist for a> e R. 
b For which cr, in e R is it true that lim^oo e~ aR e ~ lmR — 0? 

12.2 In example 12.2 it was shown that the Laplace transform of e at (a e R) is given by 
1 /( s — a) for Re s > a. Show that for a e C the same result holds for Re s > Re a. 

12.3 Consider the causal function / defined by /(f) = 1 — e(f — b) for b > 0. 
a Sketch the graph of /. 

b Determine the Laplace transform F(s) of /(f) and give the abscissa of absolute 
and ordinary convergence. 

12.4 Show that the Laplace transform of the function f 2 (hence, of e(f)f 2 ) is given by 
2/s 3 for Res > 0. 

12.5 Determine for the following functions the Laplace transform and the abscissa of 
absolute and ordinary convergence: 

a e~ 2t , 
b e(t — 4), 
c ^(2+30/ 

12.6 Determine a function /(f) whose Laplace transform is given by the following func¬ 
tions: 

a 1 /s, 
b e~ 2s /s, 
c l/(s — 7), 
d 1 /s 3 . 


12.2 Linearity, shifting and scaling 

From (12.2) it follows that ( Cf)(o + iu>) = (J~e(t) f(t)e~ al )(a>), provided that all 
the integrals exist. It will then come as no surprise that for the Laplace transform C 
and the Fourier transform T similar properties hold. In this section we will examine 
a number of elementary properties: linearity, shifting, and scaling. It will turn out 
that these properties are quite useful in order to determine the Laplace transform of 
all kinds of functions. 


12.2.1 Linearity 

As for the Fourier transform, the linearity of the Laplace transform follows imme¬ 
diately from the linearity of integration (see section 6.4.1). For a, ft e C one thus 
has 

C(ctf + fg) = a£f + fCg 

in the half-plane where Cf and Cg both exist. Put differently, when F and G are the 
Laplace transforms of / and g respectively, then af + fig has the Laplace transform 
aF + fiG', if F(s ) exists for Re .5 > oq, and G(s) for Re .s > 02 , then (aF + fiG)(s) 
exists for Rei > max(<Ti, of). This simple rule enables us to find a number of 
important Laplace transforms. 

The Laplace transform of e a is given by 1/fs — i) for Res > Ret, hence for 
Res > 0 (see exercise 12.2). Similarly one has that (Ce~ l, )(s) = 1 /(s + i) for 


EXAMPLE 12.10 
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EXAMPLE 12.11 


Res > 0. Since sin 1 = ( e u — e lt )/2i, it then follows from the linearity property 
that 

OCsinf)(5) = Yi (cCe'OM - CCe-^Cs)) 

_ j_ /_1_ 1 _\ _ (s + i) -(s- i) 

2 i \s — i s + i J 2 i(s — i)(s + i) 

2i 1 

2 i(s — i){s + i) s 2 + 1 
For Re 5 > 0 we thus have 

(£sinf)(,s) = -y-—(12.3) 

J 2 + 1 ^ 

For the function sinh t (see also exercise 11.5) one has 
(£sinhf)Cs) = ^ (( £e‘)(s ) - (Ce~ r )(s)) = * 

provided Re 5 > 1 and Re s > — 1 (see example 12.2). Hence it follows for Re s > 1 
that 

OCsinhOCH = ^ 5 ——■ (12.4) 

s~ — 1 


12.2.2 Shift in the time domain 

The unit step function is often used to represent the switching on of a signal / at 
time t = 0 (see figure 12.5a). When several signals are switched on at different 
moments in time, then it is convenient to use the shifted unit step function e(t — b) 
(see example 12.7 for its definition). In fact, when the signal / is switched on at time 
t = b (b > 0 ), then this can simply be represented by the function e(t — b)f(t — b). 
See figure 12.5b. Using the functions c(t — b) it is also quite easy to represent 


a b 



FIGURE 12.5 

A signal f(t) switched on at time t = 0 (a) and at time t = b (b). 

combinations of shifted (switched on) signals. Figure 12.6, for example, shows the 
graph of the causal function /(f) = 3 — 2e(f — l)(f — 1) + 2e(f — 3)(f — 3). In 
fact, /(f) = 3 for 0 < t < 1, /(f) = 3 — 2(f — 1) = 5 — 2f for 1 < f < 3 and 
/(f) = 3 - 2(f - 1) + 2(f - 3) = -1 for t > 3. 

There is a simple relationship between the Laplace transform F(s) of /(f) (in 
fact g(f)/(f)) and the Laplace transform of the shifted function eft — b)f(t — b). 
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THEOREM 12.4 
Shift in the time domain 


EXAMPLE 


EXAMPLE 


EXAMPLE 


THEOREM 12.5 
Shift in the s -domain 



FIGURE 12.6 

Graph of the causal function 3 — 2 e(t — l)(f — 1) + 2 eit — 3)(f — 3). 


Let f(t) be a function with Laplace transform F{s) for R es > p and let b > 0. 
Then one has for R es > p that 


C Ce(t-b)f(t-b )) (s) = e~ bs F(s). 

Proof 

By changing to the variable r = t — b we obtain that 


(12.5) 


L 


{Celt - b)f(t - b)) (s) = / f{t- b)e~ st dt = / /( r)e 


r 

Jo 


—sx—bs 


dr 


= e~ bs (£f)(s). 


where we assumed that Re s > p. This proves the theorem. 


In example 12.1 we have seen for fit) = e(t) that F(s) = 1/s for Re.v > 0. 
According to theorem 12.4, the function Ce(t — b) is then given by e~ bs /s for 
Re i > 0, which is in agreement with the result of example 12.7. ^ 

Let g(t) = eit — 2) sin(f — 2); the graph of g is drawn in figure 12.7. From example 
12.10 and theorem 12.4 it follows that iCg)is) = e~ 2s iC sinf)G) = e~ 2s /is 2 + 1) 
for Re.? >0. ^ 

Let fit) = eit — 3)(f 2 — 6 f + 9). Since t 2 — 6t + 9 = (f — 3) 2 , it follows from 
theorem 12.4 and exercise 12.4 that F(i) = 2 e~ 2s /s 2 . ^ 


12.2.3 Shift in the s-domain 

We now consider the effect of a shift in the 5 -domain. 

Let fit) be a function with Laplace transform F is) for Res > p and let b e C. 
Then one has for Re i > p + Re b that 

( Ce b, fit )) is) = F(s-b). 


( 12 . 6 ) 
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FIGURE 12.7 

Graph of e(t — 2) sin(? — 2). 


Damping theorem 
EXAMPLE 

EXAMPLE 


Proof 

Since F(s) exists for Re 5 > p, it follows that F(s — b ) exists for Re(s — b) > p, 
that is, for Res > p + Re b. For these values of s one has 

POO POO , , 

F(s -b) = J f{t)e- (s ~ b)1 dt = f e bt f(t)e~ st dt = (Ce bt f(t)) 0). 

■ 

For b < 0 the factor e bt corresponds to a ‘damping’ of the function /(t); in the 
s-domain this results in a shift over b. Therefore, theorem 12.5 is sometimes called 
the damping theorem. 

Since (£sin t)(s) = l/(s 2 + 1) (see (12.3)), it follows from theorem 12.5 that 
(Ce~ 2t sinf)(s) = l/((s + 2) 2 + 1) = l/(s 2 + 4s + 5). M 

Suppose that we are looking for a function f(t) with F(s) = l/(s — 2) 2 . From 
example 12.9 we know that ( Ct)(s ) = 1/s 2 , and theorem 12.5 then implies that 
(Cte 2t )(s) = l/(s — 2) 2 . Hence, f(t) = te 2t . At present we do not know whether 
or not this is the only possible function / having this property. We will return to 
this matter in section 13.5. ^ 


THEOREM 12.6 
Scaling 


12.2.4 Scaling 

The following theorem describes the effect of scaling in the time domain. 

Let f(t) be a function with Laplace transform F{s) for Res > p and let b > 0. 
Then one has for Re s > bp that 

(Cf{bt)){s)= l -F Q. (12.7) 

Proof 

By changing to the variable r = bt for b > 0, we obtain that 

roo j /-oo j s 

iCf(bt )) (s) = J f (bt)e~ st dt=~J o /( T)e- St ' b dr = -F (-) . 


Note that F(s/b) exists for R s(s/b) > p, that is, for Res > bp. 
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EXAMPLE 


12.7 

12.8 

12.9 

12.10 


12.11 

12.12 

12.13 

12.14 

12.15 


In example 12.10 it was shown that (C sinf)(s) = l/(s 2 + 1) for Res > 0. From 
theorem 12.6 it then follows for a > 0 that 

1 1 a 

(Cs'mat)(s) =--- = —-- for Res > 0. 

a (s/a) 2 + 1 s 2 + a- 

Since sin (—at) = — sinaf, it follows from the linearity of C that for any aelwe 
have 

(£sinaf)(s) = —-- for Res > 0. (12.8) 

s 2 + a- 

This result can also be obtained using the method from example 12.10. ^ 


EXERCISES 

a Let F(s) for Res > o\ and G(s) for Res > ff 2 be the Laplace transforms of 
/(f) and g(t) respectively. Show that (aF + fG)(s) is the Laplace transform of 
(ctf + Pg)(t) for Res > max(oy, of). 

b Determine the Laplace transform of f(t) = 3 1 2 — it + 4. 

a Use the formula cos t = (e lt + e~ u )/2, exercise 12.2, and the linearity of C to 
determine the Laplace transform of cos t. 
b Determine also, as in part a, C cos at for set. 
c Similarly, determine C, cosh at for a e I. 

Determine Ccos(at + b) and £sin(af + b) for a,b e R. (Suggestion: use the 
addition formulas for the sine and cosine functions.) 

Determine the Laplace transform F(s) of the following functions: 
a f(t) = 10f 2 -5 1 + 8 ; - 3, 
b f(t) = sin4f, 
c /(f) = cosh 5f, 
d /(f) = f + 1 — cos f, 
e /(f) = e 2 ' + e~ 3t , 
f /(f) = sin 2 f, 
g fit) = sin(f - 2 ), 
h /(f) = 3 ? . 

The function / is given by /(f) = 1 — e(f — l)(2f — 2) + e(t — 2)(t — 2). 
a Sketch the graph of /. 
b Determine F(s) = (Cf(t))(s). 

Draw the graph of the function g(t) = cos f — e(t — 2n) cos(f — 2n) and determine 
G(s) = (.Cg(t))(s). 

For Res > 0 one has (£l)(s) = 1/s. Use the shift property in the s-domain to 
determine the Laplace transform of e bt for be C. Compare the result with exercise 
12 . 2 . 


Use the scaling property and £. cos f to determine C cos at (a e R) again, and com¬ 
pare the result with exercise 12 . 8 b. 


Let /(f) be a function with Laplace transform 


F(s) = 


s 2 — s + 1 
( 2 s + l)(s - 1 ) 


for Re s > 1. 


Determine the Laplace transform G(s) of g(t) — f(2t). 
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12.16 


12.17 


12.18 


12.19 


Determine the Laplace transform F(s ) of the following functions: 

a fit) = te 2t , 

b /(f) = e(t - 1)0 - l) 2 , 

c /(f) = e _3r sin5f, 

d /(f) = cos nf for ael and b e C, 

e /(f) = e(f — 3) cosh(f — 3), 

f /(f) = rV“ 3 . 

Draw the graph of the following functions and determine their Laplace transform 

F(s): 

a /(f) = e(f - l)(f - 1), 
b /(f) = c(f)(f - 1), 
c /(f) = e(f - l)f. 


Consider the (causal) function 


/(?) = 


f for 0 < f < 1, 
0 for f > 1. 


Write / as a combination of shifted unit step functions and determine the Laplace 
transform F(s). 


Determine a function /(f) whose Laplace transform F(s) is given by: 
a F(s) = 2/(5 - 3), 
b F(s) = 3 /(s 2 + 1), 
c F(s) = 4j-/(i 2 + 4), 
d F(s) = 1 /(s 2 - 4), 
e F(s) = e~ 2s /s 2 , 

f F(s) = se~^ s /(s 2 + 1), 

g F(s) = l/((i - l) 2 + 16), 
h F(s) = ( 3s + 2 )/((i + l) 2 + 1), 
i F(s) = -6/(5 - 3) 3 , 
j F(s) = (5 - 2)/(5 2 - 45 + 8), 
k F(s) = se~ s /{4s 2 + 9). 


12.3 Differentiation and integration 

In this section we continue our investigation into the properties of the Laplace trans¬ 
form with the treatment of the differentiation and integration rules. We will examine 
differentiation both in the time domain and in the 5-domain. For the application of 
the Laplace transform to differential equations (see chapter 14) it is especially im¬ 
portant to know how the Laplace transform behaves with respect to differentiation 
in the time domain. Differentiation in the 5-domain is complex differentiation. In 
particular we will show that F(s) is analytic in a certain half-plane in C. And finally 
an integration rule in the time domain will be derived from the differentiation rule in 
the time domain. The rule for integration in the 5-domain will not be treated. This 
rule isn’t used very often and a proper treatment would moreover require a thorough 
understanding of integration of complex functions over curves in C. 


12.3.1 Differentiation in the time domain 

In section 6.4.8 we have seen that differentiation in the time domain and multipli¬ 
cation by a factor ia> in the frequency domain correspond with each other under the 
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THEOREM 12.7 
Differentiation in the time 
domain 


Differentiation in the time 
domain 


EXAMPLE 


Fourier transform. A similar correspondence, but now involving the factor s, exists 
for the Laplace transform. 

Let f be a causal function which, in addition, is differentiable on R. In a half-plane 
where Cf and Cf' both exist one has 

( Cf')(s) = s(Cf)(s). (12.9) 

Proof 

Let s e Cbe such that Cf and Cf' both exist at s. By applying integration by parts 
we obtain that 

pOO pOO 

(Cf'Hs) = J f\t)e~ st dt = [f(t)e~ sr ]™ + J J f (t)e~ st dt. 

Since / is differentiable on R, / is certainly continuous on R. But / is also causal 
and so we must have /(0) = lim r |o /(f) = 0. From this it follows that 

C Cf'Ks)= lim f(R)e~ sR + s(Cf)(s). 

R —>oo 

Since ( Cf')(s) and s(Cf)(s) exist, the limit lim^_ s . 00 f(R)e~ sR must also exist. 
But then this limit has to equal 0, for (Cf){s) = / Q f(t)e~ sl dt exists (here we 
use the simple fact that for a continuous function g(t ) with lim^^^ g(R) = a, 
where a e R and a / 0, the integral g(t) dt does not exist; see exercise 12.20). 
This proves the theorem. g 

Using the concept of a ‘function of exponential order’ (see definition 12.3), one is 
able to specify the half-planes where Cf and Cf' both exist. If we assume that the 
function /(f) from theorem 12.7 is of exponential order for a certain value a e R, 
then Cf exists for Res > a (see theorem 12.3). One can show that in this case Cf' 
also exists for Res > a. We will not go into this any further. 

By repeatedly applying theorem 12.7, one can obtain the Laplace transform of the 
higher derivatives of a function. Of course, the conditions of theorem 12.7 should 
then be satisfied throughout. Suppose, for example, that a causal function /(f) is 
continuously differentiable on R (so f' exists and is continuous on R) and that f' 
is differentiable on R. By applying theorem 12.7 twice in a half-plane where all 
Laplace transforms exist, it then follows that 

(£/")(s) = s(Cf'){s) = s 2 CC/)(s). 

Now, more generally, let /(f) be a causal function which is n — 1 times continuously 
differentiable on R (so the (n — l)th derivative /(” _ U(;) Q f /(f) exists and is con¬ 
tinuous on R) and let f^ n ~^(t) be differentiable on R (in the case n = 1 we have 
/®(f) = /(f) and by a ‘0 times continuously differentiable function' we simply 
mean a continuous function). In a half-plane where all Laplace transforms exist, we 
then have the following differentiation rule in the time domain: 

(Cf M Xs) = s n (Cf)(s). (12.10) 

For /(f) = f 2 we have f'{t) = 2f. The function e(f)f 2 is indeed differentiable on 
R and according to (12.9) we thus have s(Ct~)(s) — 2(Ct)(s). From example 12.9 
we know that (Ct)(s) = 1 /s 2 for Re.s > 0, and so (Ct~)(s) — 2/i 3 for Res > 0. 
Compare this method with exercise 12.4. ^ 

The method from the example above can be used to determine Ct n for every 
n G N with n > 2. In fact, the function e(f)f" satisfies the conditions of 
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theorem 12.7 for n e N with n > 2 and so it follows from (12.9) that 
(£nf" _1 )(5) = s(Ct n )(s). 

Since lim^oo t n e~ at — 0 for every a > 0, it follows just as in the examples 12.4 
and 12.5 that Ct n exists for Re s > 0 (n e N). Hence, 

( Ct' l ){s ) = -CCf" _1 )(5) for Res- > 0 

5 

(this result can also easily be derived by a direct calculation). Applying this result 
repeatedly, we find that 

(Ct n )(s) = - • ^ • ... • -(£l)Cs) for Re .s’ > 0. 

5 5 5 

Now finally use that (ill)(5) = l/.sforRe5 > 0 to establish the following important 
result: 

n i 

C Ct n )(s) = ——r for Re 5 > 0, (12.11) 

5«+l 

where n! = 1 • 2 • 3 • ... • (« — 1) • n. Note that (12.11) is also valid forn = 1 and 
n = 0 (0! = 1 by convention). 

Theorem 12.7 cannot be applied to an arbitrary piecewise smooth function. This 
is because the function in theorem 12.7 has to be differentiable on R and so it can 
certainly have no jump discontinuities. In section 13.4 we will derive a differen¬ 
tiation rule for distributions, which in particular can then be applied to piecewise 
smooth functions. 


THEOREM 12.8 
Differentiation in the 
5 -domain 


12.3.2 Differentiation in the s-domain 


On the basis of the properties of the Fourier transform (see section 6.4.9) we expect 
that here differentiation in the 5-domain will again correspond to a multiplication by 
a factor in the time domain. It will turn out that this is indeed the case. Still, for the 
Laplace transform this result is of a quite different nature, since we are dealing with 
a complex function F(s) here and so with complex differentiation. As in the case of 
the Fourier transform we will thus have to show that F(s ) is in fact differentiable. 
Put differently, we will first have to show that F(s) is an analytic function on a 
certain subset of C. One has the following result. 


Let f be a function with Laplace transform F(s) and let cr a be the abscissa of 
absolute convergence.Then F(s) is an analytic function of s for Re5 > ff a and 


— F(s) = —{Ctf (t)){s). 
els 


( 12 . 12 ) 


Proof 

We have to show that lim/j^ofF^ + h) ~ F(s))/h (with li —> 0 in C; see section 
11.2) exists for 5 e C with Re 5 > o d . Now 


F(s + h) - F(s) 



rOO 

f(t)e~ (s+h)t dt - / 

JO 

f(t)(e~ hl - 1 )e~ st dt, 


f (t)e~ st dt 


which means that we have to show that 



e st dt 
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Differentiation in the 
s -domain 


Multiplication by t k 
EXAMPLE 12.12 


EXAMPLE 


exists. We now assume that under the condition mentioned in the theorem we may 
interchange the limit and the integral. Note that we thus assume in particular that 
the integral resulting from the interchange will again exist. From definition 11.7, 
theorem 11.6, and the chain rule it follows that 


lint 

h-* 0 


e~ ht - 1 


h 



-t. 


This shows that 


lim 

/i^O 


F(s + h) - F(s) 
h 



(-tf(t))e~ st 


dt. 


or 


-F(s) = -(af(t))(s). 
ds 

■ 

The difficult step in this theorem is precisely interchanging the limit and the inte¬ 
gral, which in fact proves the existence of the derivative (and thus proves that F(s) 
is analytic). It takes quite some effort to actually show that the interchanging is 
allowed (see e.g. Korner, Fourier analysis, 1990, Theorem 7.5.2). If we compare 
theorem 12.8 with theorem 6.8 for the Fourier transform, then it is remarkable that 
in theorem 12.8 we do not require in advance that the Laplace transform of tfit) 
exists, but that this fact follows as a side result of the theorem. It also means that the 
theorem can again be applied to the function — tfit), resulting in 


d 2 i 

jF(s) = (£rf(t))(s ) 

for Res > o a . Repeated application then leads to the remarkable result that F(s) is 
arbitrarily often differentiable and that for Res > cr a 


d k 

j- jl F{s) = {-\) k (Ct k f{ms) for k e N. (12.13) 

We will call this the differentiation rule in the s-domain. Usually, (12.13) is applied 
in the following way: let F(s ) = (L/(t))(s), then 

d k 

c Ct k f(t))(s) = (-l) k -jF(s ) for k e N. 

Hence, this rule is sometimes referred to as multiplication by t k . 

Since (£sint)(s) = l/(s 2 + 1) for Res > 0, it follows that 
d / 1 \ 2s 

{Ct smt)(s) = -= -- = for Res > 0. 

rfs \s 2 + l/ (s 2 + l) 2 

◄ 

We know that (£e -3, )(s) = l/(s + 3), so 


0 Ct 2 e~ 3, )(s) = ^ 


ds 2 \s + 3/ (s + 3) 3 


This result also follows by noting that ( Ct z ){s ) = 2/s 5 and subsequently using the 
shift property from theorem 12.5. ^ 
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THEOREM 12.9 
Integration in the time 
domain 


EXAMPLE 12.13 


EXAMPLE 12.14 


12.3.3 Integration in the time domain 


From the differentiation rule in the time domain one quickly obtains the following 
result. 


Let f be a causal function which is continuous on R and has Laplace transform 
F{s). Then one has in a half-plane contained in the region Re s > 0 

( cj'f{T)dT^ ( 5 ) = jF(j). (12.14) 

Proof 

Define the function g{t) by g(t) = f!_ 0O f(T)dr = Jq f(r)d r, then g is the 
primitive of / with g(0) = 0 and g(f) — 0 for t < 0. Since / is continuous, it 
follows that g is differentiable on R. According to theorem 12.7 one then has, in 
a half-plane where both Laplace transforms exist, that (Cg')(s) — s(Cg)(s). But 
g' = f and so 

s f Q 0 s ) = F CO- 

In a half-plane where both Laplace transforms exist and which lies to the right of 
Re s = 0, one may divide by s and so the result follows. g 


The causal function sin t is continuous on R and since Jq sin r dr = 1 — cos t. it 
then follows from theorem 12.9 that 

CC(1 - cosf))(s) = -(£sinf)(,s) = — 1 . 

s s(s 2 + 1) 


This result is easy to verify since we know from table 7 that (C cos D(s) = s/(s 2 + l) 
and (C I )(s) = 1/s. Hence, 


CC( 1 — cos f))(s) = 


1 

s 


s 

s 2 + 1 


(s 2 + 1) — s 2 1 

s(s 2 + 1) s(i 2 + 1) 


◄ 


As in the case of theorem 12.7 one can use the concept ‘function of exponential 
order’ to specify the half-planes where the Laplace transforms exist. If a function 
fit) is of exponential order for a certain a e R, then one can show that the result 
from theorem 12.9 is correct for Re 5 > max(0, a). We will not go into this matter 
any further. 

Theorem 12.9 can also be applied in the ‘opposite direction'. When we are look¬ 
ing for a function /(f) whose Laplace transform is F(s ), then we could start by first 
ignoring factors 1/s that might occur in F(s). In fact, such factors can afterwards 
be re-introduced by an integration. 

Let g(t) be a function with Laplace transform G(s) = 4/(s(s 2 + 4)). If we ignore 
the factor 1/s, then we are looking for a function h(t) having Laplace transform 
H(s) — 4/(s 2 + 4). This is easy: h(t) = 2 sin2f. Integrating h(t) we find g(t): 

g(t) = f 2 sin2r dr = [— cos2t]q = 1 — cos2f. 


EXERCISES 

Let g(r) be a continuous function on R. Show that g(t)dt does not exist if 
lim^^oo g(R) = a where oeR and a/0. 


12.20 



12.3 Differentiation and integration 


285 


12.21 

12.22 

12.23 

12.24 

12.25 

12.26 

12.27 

12.28 

12.29 


Show that lim r _*.oo t n e~ at = 0 for any n G N and a > 0 and use this to show that 
the function t n is of exponential order with a > 0 arbitrary. Conclude that (Ct n )(s) 
exists for Re s > 0. 


Use the definition to show that for any n e N one has 

(,£f")(s) = -(£f" _1 )(s) for Res > 0. 
s 

One has that (Cl )(s) = 1/s for Res > 0. Use the differentiation rule in the s- 
domain to show that (Ct n )(s) = u!/s" +1 for Res >0. 

In example 12.12 we used the differentiation rule in the s-domain to show that 
(Ct sin f)(s) = 2s/(s 2 + l) 2 for Re s > 0. Since t sinf = (te il — te~ i, )/2i, one 
can also derive this result quite easily using the shift property. Give this derivation. 

Consider the function /(f) = t n e at fora e C and let F(s) = (£/(f))(s). 
a Determine F(s) using a shift property, 
b Determine F(s) using a differentiation rule. 

Determine the Laplace transform G(s) of g(t) = /q t cos It dr. 

One has that (C sinhaf)(s) = a/(s 2 —a 2 ) for Res > a (a e M). Which function 
f(t) has o/(s(s 2 — a 2 )) as its Laplace transform? 

Determine the Laplace transform F(s) of the following functions: 
a /(f) = f 2 cos at, 
b /(f) = (f 2 — 3f + 2) sinh3f. 


Determine a function /(f) whose Laplace transform F(s) is given by: 




1 


s 1 + 1 


b F(s) = 


s 2 (s 2 — 1) 


SUMMARY 

The Laplace transform F(s) of a causal function /(f) is defined for s e C by 

poo 

F(s)= / f(t)e~ s, dt. 

Jo 

There exists a number cr a e R with —oo < o & < oo, such that the integral is ab¬ 
solutely convergent for all s e C with Res > <r a and is not absolutely convergent 
for all s e C with Res < o d . The number o a is called the abscissa of absolute 
convergence. The case o & = oo almost never occurs in practice, since most func¬ 
tions are of exponential order, so | /(f) | < Me 0 " for certain M > 0 and a e R. 
For ordinary convergence there are similar results; in this case we have a abscissa of 
convergence o c . For the unit step function e(t) one has, for example, cr a = cr c = 0; 
for Res > 0 the Laplace transform of e(f) is given by 1/s. A number of standard 
Laplace transforms, together with their abscissa of convergence, are given in table 7. 

There is a simple relationship between the Laplace and the Fourier transform: 
(Cf )(a + iia) = (J r e(t)f(t)e~ at )(u>). Therefore, the properties of the Laplace 
transform are very similar to the properties of the Fourier transform. In this chap¬ 
ter the following properties were treated: linearity, shifting in the time and the s- 
domain, scaling in the time domain, differentiation in the time and the s-domain, 
and integration in the time domain. These properties are summarized in table 8. In 
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particular it was shown that the Laplace transform is an analytic function in a certain 
half-plane in C. 


12.30 


12.31 


12.32 


12.33 


SELFTEST 


Consider the function 


fit) = 


2 1 for 0 < t < 1, 
t for t > 1. 


a Sketch the graph of / and write / as a linear combination of functions of the 

form eft — a) and e(t — b)(t — b). 

b Determine the Laplace transform Fis) of fit). 

c Determine f' (at all points where f exists) and determine Cf'. 

d Is the differentiation rule in the time domain valid in this case? Explain your 

answer. 


In this exercise F{s) is the Laplace transform of a certain piecewise smooth causal 
function fit). 

a Determine Cf{t) sin of, where ael. 
b Determine Ce~ 2t ff3t) when F(s) = e~ s /s. 

c Determine C /q t 3 /(t) dr when it is also given that fit) is continuous on R. 


Determine the Laplace transform F(s) of the following functions: 
a fit) = 3e‘~ 2 + eit — 2), 
fit) = it - l) 2 , 
fit) = e 2, eit - 4), 
fit) = e -r (cos2 1 + i sin2r), 
fit) = e r+3 eit - 2) sin(f - 2), 
fit) = 3 r cos 2 1, 

1 for 0 < t < 1, 

0 for 1 < t < 2, 

1 for 2 < t < 3, 

0 for t > 3. 


m = 


Determine a function fit) whose Laplace transform Fis) is given by the following 
functions: 

a Fis) = (1 - e~ s )/s, 
b Fis) = (s 3 + 3)//, 

c Fis) = l/(i + l) 2 + 1 / is 2 - 4) + (1 + e-™)/(s 2 + 1), 
d Fis) = (35 - 2)/(5 2 - 45 + 20), 
e Fis) = (5 + 3)/(5 2 + 85 + 16), 
f F(5) = e“ 4 7(5-2) 3 , 

g Fis) = e~ s /isis 2 + 9)). 
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CHAPTER 13 


Further properties, distributions, and 
the fundamental theorem 


INTRODUCTION 


In the first three sections of this chapter the number of properties of the Laplace 
transform will be extended even further. We start in section 13.1 with the treatment 
of the by now well-known convolution product. As for the Fourier transform, the 
convolution product is transformed into an ordinary product by the Laplace trans¬ 
form. 

In section 13.2 we treat two theorems that have not been encountered earlier in 
the Fourier transform: the so-called initial and final value theorems for the Laplace 
transform. The initial value theorem relates the ‘initial value’ /(0+) of a function 
/(f) to the behaviour of the Laplace transform F(s) for s —> oo. Similarly, the final 
value theorem relates the ‘final value’ limr-s.oo /(f) to the behaviour of F(s ) for 
.y —> 0. Hence, the function F(s) can provide information about the behaviour of 
the original function /(f) shortly after switching on (the value /(0+)) and 'after a 
considerable amount of time" (the value lim f _ s . 00 fit)). 

In section 13.3 we will see how the Laplace transform of a periodic function can 
be determined. It will turn out that this is closely related to the Laplace transform of 
the function which arises when we limit the periodic function to one period. 

In order to determine the Laplace transform of a periodic function, it is not neces¬ 
sary to turn to the theory of distributions. This is in contrast to the Fourier transform 
(see section 9.1.2). Still, a limited theory of the Laplace transform of distributions 
will be needed. The delta function, for example, remains an important tool as a 
model for a strong signal with a short duration (a ‘pulse’). Moreover, the response 
to the delta function is essential in the theory of linear systems (see chapter 14). The 
theory of the Laplace transform of distributions will be developed in section 13.4. 
In particular it will be shown that the Laplace transform of the delta function is 
the constant function 1, just as for the Fourier transform. We will also go into 
the relationship between the Laplace transform of distributions and differentiation, 
and we will treat some simple results on the Laplace transform and convolution of 
distributions. 

In section 13.5 the fundamental theorem of the Laplace transform is proven. In 
the theory of the Laplace transform this is an important theorem; it implies, for 
example, that the Laplace transform is one-to-one. However, in order to apply the 
fundamental theorem in practice (and so recover the function f(t) from F(s)), a 
fair amount of knowledge of the theory of complex integration is needed. This 
theory is beyond the scope of this book. Therefore, if we want to recover f(t) from 
F(s), we will confine ourselves to the use of tables, the properties of the Laplace 
transform, and partial fraction expansions. This method will be illustrated by means 
of examples. 
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LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know and can apply the convolution of causal functions and the convolution theo¬ 
rem of the Laplace transform 

- know and can apply the initial and final value theorems 

- can determine the Laplace transform of a periodic function 

- know and can apply the Laplace transform of some simple distributions 

- know and can apply the differentiation rule for the Laplace transform of distribu¬ 
tions 

- can apply the convolution theorem for distributions in simple cases 

- know the uniqueness theorem for the Laplace transform 

- can find the inverse Laplace transform of complex functions by using a table, ap¬ 
plying the properties of the Laplace transform, and applying partial fraction ex¬ 
pansions. 


13.1 Convolution 


Convolution of causal 
functions 


THEOREM 13.1 
Convolution theorem for C 


We have already encountered the convolution product of two functions / and g : 
R —»■ C in definition 6.4. When, moreover, / and g are both causal (which is 
assumed throughout part 4), then one has for t > 0 that 

f(T)g(t-T)dr=[ f(z)g(t-z)dz, 

Jo 

since the integrand is zero for both z < 0 and t — z < 0. For the same reason one 
has {f *g)(t) = 0 if t < 0 (also see exercise 6.25). If, moreover, we assume that the 
causal functions / and g are piecewise smooth, then the existence of the convolution 
product is easy to prove. In fact, for fixed t > 0 the function z —y f{z)g{t — r) 
is then again piecewise smooth as a function of z and such a function is always 
integrable over the bounded interval [0, f]. Hence, for two piecewise smooth causal 
functions / and g, the convolution product exists for every (el and f * g is again 
a causal function. One now has the following convolution theorem (compare with 
theorem 6.13). 

Let f and g be piecewise smooth and causal functions. Let the Laplace transforms 
F = Cf and G — Cg exist as absolutely convergent integrals in a half-plane 
R es > p. Then C(f * g ) exists for Res > p and 

L(f*g)(s) = F(s)G(s). (13.1) 


/ oo 

-00 


Proof 

Since f(t) = g(t) — 0 for t < 0, it follows for Re 5 > p that 


/ OO rOO 

f(t)e~ st dt I g(u)e~ SLl du. 

-oo J—oo 

Since the second integral does not depend on t, we can write 

F(s)G(s) = [°° ( [°° f(t)g(u)e- s(,+u) du)dt. 

J —oo \J —oo / 

to the new 

-£(/. 


Now change to the new variable t + u = t, then 

1*00 / POO 


F(s)G(s) = 


f(t)g(z — t)e ST dr)dt. 
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EXAMPLE 13.1 


EXAMPLE 


EXAMPLE 


13.1 


Without proof we mention that under the conditions of theorem 13.1 we may change 
the order of integration. We then obtain: 

/ OO / rOO 

e~ ST 

-OO \J — OO 

As indicated above, the inner integral is the convolution product of the two causal 
functions / and g. Hence, C{f * g ) exists and Lif * g)(s) = F(s)G(s). g 


/(f)g(T - t)dt) dr. 


In theorem 13.1 a half-plane is mentioned for which the Laplace transforms F 
and G exist as absolutely convergent integrals. If /(f) and git) are of exponential 
order for a e R and p e R respectively, then more can be said. For we then know 
from theorem 12.3 that the integrals for F(s) and G{s) are absolutely convergent 
for Re.v > a and Re 5 > p. Hence, in this case both Laplace transforms exist as 
absolutely convergent integrals in the half-plane Res > p , where p — maxlcc, /). 

Let f{t) = e 1 and git) = t, then F(s) = l/(s — 1) and G(s) = 1 /s~ (see table 7), 
so F(s)G(s) = l/(s 2 (s — 1)). From the convolution theorem it then follows that 
Cie v * v)(s) = l/(s 2 (s — 1)). The convolution theorem can easily be verified in 
this case by calculating the convolution product and then determining its the Laplace 
transform. We calculate the convolution product using integration by parts: 

(e l ’*v)(f)= f e r it — r) dr = \e r (t — r)]i + f e T dr 
JO Jo 

— ~t + Hq = -t + e' - 1. 

Furthermore, we have Lie 1 — t — l)(s) = 1 /is — 1) — 1/s 2 — 
calculation will show that this result is indeed equal to 1/ (s 2 (s — 

Let fit) be an arbitrary (causal) function and git) = e(f). Then 
(/*g)0)= f /(r)e(l - z)dx = f fir) dr, 

Jo Jo 

while F(s)G(s) = F(s)/s. Hence, in this case the convolution theorem reduces to 
the integration rule (12.14) from section 12.3.3. ^ 

Suppose one is asked to determine a function / with (G/)(s) = F(s) = l/(s 2 + 
l) 2 . From table 7 we know that (£sint)(s) = l/(s 2 + 1) and by virtue of the 
convolution theorem we thus have fit) = (sinv * sinv)(f). It is not so hard to 
calculate this convolution using the trigonometric identity 2 since sin fi = cos (a — 
P) - cos (o' + P): 

(sinv * sinv)(l) = / sin r sin(f — r) dr = i / (cos(2r — t) — 

Jo Jo 

= ^ sin(2r — f)J^ — j cost [r]g = ^ sinf — 

Check for yourself that indeed (G(sinf — t cost)/2)is) = 1 /is 2 + 

EXERCISES 

Show that (cos v * cos v)(f) = (sin t + t cos t) /2. Use this to verify the convolution 
theorem for the functions fit) — git) = cos t. (Suggestion: use the trigonometric 
identity 2 cos a cos p = cos (a + P) + cos (a — /?).) 


cos t) dr 
2 cos t. 
I) 2 . 


1/s and a simple 
!))• ◄ 


13.2 


a Determine a function / with iCf)is) = F(s) = l/(s — a), where a e C. 
b Use the convolution theorem to determine a function git) such that 
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THEOREM 13.2 


(£g)(s) = 1 /((s — a)(s — b)). Calculate the obtained convolution product explicitly 
and verify the convolution theorem for this case. 

13.3 Verify the convolution theorem for the functions /(f) = r 2 and g(f) = e l . 

13.4 Determine a convolution product (/ * g)(f) whose Laplace transform is given by 
the following complex function: 

a l/(s 2 (s + l)), 
b s/((s + 2)(s 2 + 4)), 
c s/(s 2 - l) 2 , 
d I/O 2 - 16) 2 . 


13.2 Initial and final value theorems 

In this section we treat two theorems that can give us information about a function 
/(f) straight from its Laplace transform F(s), without the need to determine /(f) 
explicitly. The issues at stake are the limiting value of / at the point t = 0. so 
immediately after the ‘switching on', and the limiting value of / for t -*■ oo, that 
is, the final value after ‘a long period of time’. These two results are therefore called 
the initial and final value theorems. As a matter of fact, they can also be used in the 
opposite direction: given /(f), one obtains from these theorems information about 
the behaviour of F(s) for s —*■ 0 and for s oo, without having to determine F(s ) 
explicitly. 

A brief explanation of the notation ‘s -» oo’ is appropriate here, since s is com¬ 
plex. In general it will mean that | s | —» oo (so the modulus of s keeps increasing). 
In most cases this cannot be allowed for a Laplace transform F(s) since we might 
end up outside the half-plane of convergence. By lirn s _ s . 00 F(s) we will therefore 
always mean that | s | -> oo and that simultaneously Re s —r oo. In particular, s will 
lie in the half-plane of convergence for sufficiently large values of Re s (specifically, 
for Res > <r c ). 

Similar remarks apply to the limit s —>■ 0, which will again mean that | s | —>■ 0 
(as in section 11.2). If the limit for s 0 of a Laplace transform F(s) is to exist, 
then F(s) will certainly have to exist in the half-plane Res > 0. When the half¬ 
plane of convergence is precisely Re s > 0, then the limit for s —> 0 has to be taken 
in such a way that Res >0 as well. By lim s ^o F(s) we will therefore always mean 
that | s | —> 0 and that simultaneously Re s J, 0. 

Before we start our treatment of the initial value theorem, we will first derive the 
following result, which, for that matter, is also useful in other situations and will 
therefore be formulated for a somewhat larger class of functions. 

For the Laplace transform F(s) of a piecewise continuous function /(f) we have 

lim F(s) = 0, 
s—roo 

where the limit s —> oo has to be taken in such a way that Re s —*■ oo as well. 
Proof 

If s —>■ oo such that Re s —> oo as well, then lim^oo e~ st = 0 for any fixed t > 0. 
In fact, for s = a + iu> we have e~ s< = e~ ar e~ l0Jt and linv-^oo e~ al = 0 for any 
t > 0. Hence we obtain that 

rOO 

lim F(s)= lim / f{t)e~ st dt = 0, 

s—roo s—roo J q 
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EXAMPLE 
EXAMPLE 13.2 


THEOREM 13.3 
Initial value theorem 


EXAMPLE 

EXAMPLE 


i/we assume that we may interchange the integral and the limit. When the function 
/(f) is of exponential order, then the problem of the interchanging of the limit and 
the integral can be avoided. For if | /(f) | < Me 01 ', then 


I F(s) | < 


r 

JO 


I fit ) I e~ ar dt < M 


r 

Jo 


M-o), dt = 


M 




for all a a. We also agreed that Re.s- = a —>■ oo and for sufficiently large o one 
will have that a > a, so a — o < 0. It thus follows that 



lim e (a - (7)R - 1 = -1, 
R—>oo 


which proves that | F(s) \ < Ml (a — a). In the limit s —> oo with Re.v = a —> 
oo, the right-hand side of this inequality tends to zero, from which it follows that 
lim.5_5.00 F(s) = 0 as well. g 


For /(f) = e(f) we have F(s ) = 1 /s. Indeed, lim. 5 -s .00 F(s) =0. ^ 

The constant function F(s) = 1 cannot be the Laplace transform of a piecewise 
continuous function /(f). This is because lim.5_5.00 F(s ) = 1. ^ 

We recall that for a piecewise smooth function /(f) the limit /(0+) = lim^o fit) 
will always exist. The initial value theorem is a stronger version of theorem 13.2 
and reads as follows. 

Let f(t) be a piecewise smooth function with Laplace transform F(s). Then 


lim sF(s) = /(0+), (13.2) 

s —>00 

where the limit s -» 00 has to be taken in such a way that Re 5 -» 00 as well. 
Proof 

We will not prove the theorem in its full generality. However, if we impose an 
additional condition on the function /(f), then a simpler proof of the initial value 
theorem can be given using theorem 13.2. We therefore assume that in addition /(f) 
is continuous for f > 0. Let f be the derivative of / at all points where f' exists. 
As in the proof of theorem 12.7, it then follows from an integration by parts that 

iCf)is) = lim f{R)e~ sR - /(0+) + sF(s) = sF(s) - /(0+), 

R—>00 

since lim^^oo e~ sR — 0 (see the proof of theorem 12.7). The difference with 
theorem 12.7 is the appearance of the value /(0+) because / is not necessarily 
continuous at f = 0. If we now apply theorem 13.2 to /'(f), then it follows that 
lim s ^ 0 o(L/ , )(,S') = 0. Hence we obtain that lim s _>.oo(.sE(.s) — /(0+)) = 0, 
which proves the theorem, under the additional condition mentioned earlier. g 


Theorem 13.3 can be used in both directions. When F(s) is known and /(f) is 
hard to determine explicitly, then one can still determine /( 0 +), provided that we 
know that / is piecewise smooth. When on the other hand /(f) is known and F(s) 
is hard to determine, then theorem 13.3 reveals information about the behaviour of 
F(s) for s —> 00 . 

The function e(f) has the function F(s ) = 1/s as Laplace transform. Indeed, 1 = 
6(0+) = lim.5_5.00 sF(s). M 

Consider the function /(f) = e~ ht cosh of. Then /(0+) = 1 and the Laplace 
transform F(s) exists, so lim. 5 _ 5.00 sF(s) — 1. This can easily be verified since 
F{s) = (s + b)/Hs + b)~ — a~) (see table 7). 


◄ 
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THEOREM 13.4 
Final value theorem 


EXAMPLE 

EXAMPLE 13.3 


We now move on to the final value theorem, which relates the final value /(oo) = 
/(f) (a notation which will be used henceforth) to the behaviour of F(s) 
for i -»• 0. 

Let fit) be a piecewise smooth function with Laplace transform F(s). When 
/(oo) = lim^oo /(f) exists, then 

lim sF(s) = /(oo), (13.3) 

s—r 0 

where the limit s —*■ 0 has to be taken in such a way that Rev / 0 as well. 

Proof 

Again, theorem 13.4 will not be proven in full generality. If we impose a number of 
additional conditions on the function, then a simpler proof can be given, as was the 
case for theorem 13.3. We first of all assume that in addition /(f) is continuous for 
f > 0. As in the proof of theorem 13.3, it then follows that (Cf')(s) = sF(s) — 
f (0T). Next we will assume that this result is valid in the half-plane Re s > 0. For 
the limit s —> 0 (with Re s / 0) we then have 

roo 

lim sF(s) = /(0+) + lim / f\t)e~ s ’ dt. 

s—r 0 s—rOJo 

Now, finally, assume that the limit and the integral may be interchanged, then we 
obtain that 

roo 

lim sF(s) = /(0+) + / /'(f) dt. 

s-r 0 Jo 

Since / is piecewise smooth and continuous for f > 0 and since, moreover, 
hni/^oo /(f) exists, we have finally established that 

lim sF(s) = /(0+) + [/(f)]g° = lim /(f) = /(oo). 
j-s -0 f->oo 

This proves theorem 13.4, using quite a few additional conditions. g 

We note once again that F(s) in theorem 13.4 must surely exist for Res >0, be¬ 
cause otherwise one cannot take the limit s —>■ 0. When F(s) is a rational function, 
then this means in particular that the denominator cannot have any zero for Re s > 0 
(see example 13.3). 

One cannot omit the condition that lim f _ ! . 00 /(f) should exist. This can be shown 
using a simple example. The function /(f) = sinf has Laplace transform F(s) — 
l/(s 2 + 1). We have lim s _*.o sF{s) = 0, but lim^oo /(f) does not exist. 

Theorem 13.4 can again be applied in two directions. When F(s) is known, 
/(oo) can be determined, provided that we know that /(oo) exists. If, on the other 
hand, /(f) is known and /(oo) exists, then theorem 13.4 reveals information about 
the behaviour of F(s) for s —> 0. 

The function eft) has Laplace transform FIs) = I /s and indeed we have 1 = 
Hindoo e(f) = linwo fF(s). M 

Consider the function /(f) = e~ at with a > 0. Then limf->.oo /(f) = 0 and so 
lini^o sF(s ) = 0. This can easily be verified since F(s ) = l/(s + a). Note that 
for a < 0 the denominator of F(s) has a zero for s = —a > 0, which means that in 
this case F(s) does not exist in the half-plane Re 5 >0. This is in agreement with 
the fact that lirn^oo /(f) does not exist for a < 0. Of course, the complex function 
F(s) — 1 /(s + a) remains well-defined for all 5 —a and in particular one has 
for a 0 that lim^^o sF(s) — 0. However, the function F(s) is not the Laplace 
transform of the function /(f) for Re.s < (—a). ^ 
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EXERCISES 

13.5 Can the function F(s ) = s n (n e N) be the Laplace transform of a piecewise 
continuous function /(f)? Justify your answer. 

13.6 Determine the Laplace transform F(s) of the following functions /(f) and verify 
the initial value theorem: 

a /(f) = cosh 3f, 
b /(f) = 2 + f sinf, 

c /(f) = Jq g( t) dr, where g is a continuous function on R. 

13.7 In the proof of theorem 13.3 we used the property ( Cf')(s ) = s{Cf){s) — /(0+). 
Now consider the function /(f) = e(t — 1) cos(f — 1). 

a Verify that the stated property does not hold for /. 
b Show that the initial value theorem does apply. 

13.8 Determine the Laplace transform F(s) of the following functions /(f) and verify 
the final value theorem: 

a f(t) = e- 3 >, 
b /(f) = e~ 1 sin 2f, 
c /(f) = l-e(f-l). 

13.9 Determine whether the final value theorem can be applied to the functions cos f and 
sinh f. 

13.10 For the complex function F(s) = l/(sO? — 1)) one has lintj^o sF(s) — —1. Let 

/(f) be the function with Laplace transform F(s ) in a certain half-plane in C. 
a Explain, without determining /(f), why the final value theorem cannot be 
applied. 

b Verify that F(s) = l/(s — 1) — 1 /s. Subsequently determine /(f) and check 
that /(oo) = lirn^oo /(f) does not exist. 


13.3 Periodic functions 


Causal periodic function 


In general, the Laplace transform is more comfortable to use than the Fourier trans¬ 
form since many of the elementary functions possess a Laplace transform, while 
on the contrary the Fourier transform often only exists when the function is consid¬ 
ered as a distribution. For a periodic function the Fourier transform also exists only 
if it is considered as a distribution (see section 9.1.2). In this section we will see 
that the Laplace transform of a periodic function can easily be determined without 
distribution theory. Since we are only working with causal functions in the Laplace 
transform, a periodic function /(f) with period T > 0 will from now on be a func¬ 
tion on [0. oo) for which f(t + T) = f(t ) for all f > 0. In figure 13.1a a periodic 
function with period T is drawn. Now consider the function 0(f) obtained from 
/(f) by restricting /(f) to one period T , so 


/(f) for 0 < f < T, 
0 elsewhere. 


See figure 13.1b. Using the shifted unit step function, the function 0(f) can be 
written as 


0(f) = fit) -e(t-T)f(t~T). 
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THEOREM 13.5 

Laplace transform of periodic 
functions 


a 



b 



FIGURE 13.1 

A periodic function / (a) and its restriction / (b). 


If we now apply the shift property in the time domain (theorem 12.4), then it follows 
that 

4>(s) = F(s) - e~ sT F(s) = (1 - e~ sT )F(s), 

where <I>(s) and F(s ) are the Laplace transforms of / and / respectively. If s = 
a + ia> and a > 0, then j e~ sT | = e~ aT < 1, and hence 1 — e~ sT 0. For 
Re 5 > 0 we may thus divide by 1 — e~ sT and it then follows that 

<t>(.s) C°° C T 

F(s)= - —where <t>(s) = / <p(t)e sl dt = / f(t)e st dt. 

1 - e sl Jo Jo 

Note that for a piecewise continuous function the preceding integral over the 
bounded interval [0, T] exists for every s e C; for the function cj> the abscissa 
of convergence is thus equal to — oo. For the periodic function / the abscissa of 
convergence is equal to 0 and hence the Laplace transform F(s) exists for Re s > 0. 
We see here that the Laplace transform of a periodic function can be expressed in 
a simple way in terms of the Laplace transform of the function restricted to one 
period. These results are summarized in the following theorem. 

Let f be a piecewise smooth and periodic function with period T and let <t>(s) be the 
Laplace transform ofcj>{t) = f(t) — e(t — T)f(t — T). Then the Laplace transform 
F(s) of fit) is for Re.v > 0 given by 

<D(j) f T 

F(s)= -_, where 4>(^) = / f(t)e ' dt. (13.4) 

1 - e SI Jo 

Consider the periodic block function f(t) with period 2 defined by f(t) = l — e(f — 
1) for 0 < t < 2; so /(f) = 1 for 0 < t < 1 and /(f) = 0 for 1 < f < 2. See 
figure 13.2. We then have /(f) = 1 — e(f — 1) and from tables 7 and 8 we see 


EXAMPLE 13.4 
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13.11 


13.12 


13.13 


13.14 


1 


-o 


o 


■o 


0 


4 -4 -*- 1 - 4 -► 

1 2 3 4 5 f 


FIGURE 13.2 
Periodic block function. 


that ( £<p(t))(s) — <t>(s) = 1/s — e s /s. Using theorem 13.5 we thus find for the 
Laplace transform F(s) of /(f) that 


F(s) = 


1 — e~ s 
s( \-e~ 2s ) 


1 

s(l + e~ s ) 


< 


EXERCISES 

Let /(f) for f > 0 be a periodic function with period T. 

a Can we apply the final value theorem to the periodic function /? Justify your 
answer, 
b Show that 

i r T 

lim sF(s) = — / f{t)dt. 

■s—>0 1 Jo 

In other words, in this case the limit lim s _^o sF(s ) equals the average value of / 
over one period. (Suggestion: use the definition of the derivative of the complex 
function e~ zT at the point z = 0.) 

c Verify the result from part b for the function /(f) from example 13.4. 

In figure 13.3 the graph is drawn of a periodic block function /(f) with period 2a, 
defined for 0 < f < 2a by 

| 1 for 0 < f < a, 

j —1 fora < t < 2a. 

a Define /(f) as the restriction of / to the period [0, 2a). Show that /(f) = 
e(f) — 2 e(t — a) + e(t — 2a). Determine the Laplace transform F(s) of /(f). 
b Show that F(s) = (tanh(ai/2))/^, where tanhz = sinhz/coshz = ( e z — 
e~ z )/(e z + e~ z ). 

The periodic sawtooth function / with period 2 is given by /(f) = f(e(f) — e(f — 
2)) - 2(e(f - 1) - e(f - 2)) for 0 < f < 2. 
a Sketch the graph of /. 
b Determine F(s) = ( Cf)(s ). 

Let / be the periodic function with period 2 given by /(f) = f for 0 < f < 2. Show 
that (, Cf)(s ) = F(s) = (1 + 2s)/s~ - 2/^(1 - e~ 2s )). 
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2 a 


3 a 


4a 


5a f 


-1 


FIGURE 13.3 

Periodic block function of exercise 13.12. 

13.4 Laplace transform of distributions 

Up till now we have been able to avoid the use of the theory of distributions in 
the Laplace transform. For every function we could always calculate the Laplace 
transform using the defining integral (12.1). Still, we will need a limited theory of 
the Laplace transform of distributions. This is because the delta function will remain 
an important tool in the theory of linear systems: in the application of the Laplace 
transform the impulse response again plays an essential role (see chapter 14). 

In section 13.4.1 the main results will be derived in an intuitive way. For the 
remainder of this book it will suffice to accept these results as being correct. In 
section 13.4.2 we treat the mathematical background necessary to give a rigorous 
definition of the Laplace transform of a distribution. This will enable us to prove 
the results from section 13.4.1. Section 13.4.2 may be omitted without any conse¬ 
quences for the remainder of the book. 


13.4.1 Intuitive derivation 


To get an intuitive idea of the Laplace transform of the delta function S(t), we con¬ 
sider the causal rectangular pulse r^ft) of height l/b and duration b > 0. Hence, 
rb(t) = (e(t) — e(t — b))/b. See figure 13.4. Note that rt,(t) dt = 1 for every 
b > 0. For b J, 0 we thus obtain an object which, intuitively, will be an approxima¬ 
tion for the delta function (see section 8.1). Since ( Cr[,)(s ) = (1 — e~ bs )/sb, we 
expect that for b J, 0 this will give us the Laplace transform of the delta function. 
When b ! 0, then also —sb —> 0 for any j e C. Now write z = —sb, then we 
have to determine the limit lim z _^o(e z — 1 )/z. But this is precisely the derivative 
of the analytic function e z at z = 0. Since ( e z )' = e z , we obtain for z = 0 that 
(e z )'( 0) = 1 and hence linty, i oOCffeXs) = L As for the Fourier transform, we 
thus expect that the Laplace transform of the delta function will equal the constant 
function 1. 

We will now try to find a possible definition for the Laplace transform of a dis¬ 
tribution. First we recall that a function fit ) can be considered as a distribution T f 
by means of the rule 



f(t)4>(t) dt for tp e S. 


(13.5) 
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FIGURE 13.4 

The rectangular pulse function rft(f) for some values of b. 


EXAMPLE 13.5 


(See (8.12).) If we now take for / the function e st , then it follows for a causal 
function f(t ) that 


( : T f • 



f(t)e~ st dt = F(s). 


(13.6) 


The definition of the Laplace transform U = CT of a distribution T now seems 
quite obvious, namely as the complex function 


U(s) = (T(t),e~ st ). 


(13.7) 


Note that T(t) acts on the variable t and that $ is always an (arbitrary) fixed com¬ 
plex number. Furthermore, the Laplace transform of a distribution is no longer a 
distribution, but just a complex function. When f{t ) is a causal function defining a 
distribution Tf, then it follows from (13.6) that the definition in (13.7) results in the 
ordinary Laplace transform F(s) of /(f) again: 


0 CT f )(s) = F(s) (13.8) 

(assuming that F(s) exists in a certain half-plane of convergence). 

Two problems arise from definition (13.7). First of all it is easy to see that the 
function e~ st is not an element of the space <S(R) of rapidly decreasing functions; 
hence, [T, e ~ st ) is not well-defined for an arbitrary distribution T. A second prob¬ 
lem concerns the analogue of the notion ‘causal function’ for a distribution, since 
(13.6) is only valid for causal functions. Of course we would like to call the distri¬ 
bution Tf ‘causal’ if / is a causal function. But what shall we mean in general by 
a ‘causal distribution’? This will have to be a distribution being ‘zero for t < O’. 
In section 13.4.2 we will return to these problems and turn definition (13.7) into a 
rigorous one. In this section we use (13.7) for all distributions that are ‘zero for 
t < 0’ according to our intuition. Examples of such distributions are the delta func¬ 
tion (5(f), the derivatives S^ n \t) (n e N), the delta function 5(f — a) with a > 0, and 
the derivatives S^(t — a) (a > 0 and n e N). 


From formula (13.7) and definition 8.2 of 5(f) it follows that (£5(f))(s) = 
(5(f), e~ st ) = 1 since e~ st = 1 for t = 0. Hence, £5=1. ■< 
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EXAMPLE 13.6 

EXAMPLE 13.7 

Linearity 

EXAMPLE 

Differentiation in the time 
domain 


EXAMPLE 

EXAMPLE 

EXAMPLE 13.8 


For the delta function 8{t — a ) with a > 0 it follows from formulas (13.7) and (8.10) 
that (£8{t — a))(s) = (5(f — a), e ~ st ) = e~ as . Hence, (C8(t — a))(s) = e~ as . ^ 

For the derivative 8^ n \t) it follows from formulas (13.7) and (8.17) that 
(CS^itMs) = (s^ n \t), e~ sr ^j = (—1 ) n (8(t),(e- st ) w ). But (e~ st )W = 
(—s) n e~ st and so = s" (S(t), e~ st ) = s n . This proves that 

(£«<">(f))(s) = *". M 

The properties of the Laplace transform of distributions are similar to the proper¬ 
ties of the Laplace transform of functions (and to the properties of the Fourier trans¬ 
form). The simplest property is linearity. It follows immediately from the definition 
in (13.7) and definition 8.5 of the addition of distributions and the multiplication of 
a distribution by a complex constant. 

The Laplace transform of 3i8(t — 4) + 5 sin t is given by the complex function 
3 ie~ 4s + 5/(s 2 +1). ^ M 

Besides linearity, the most important property will be the differentiation rule in 
the time domain: when T is a distribution with Laplace transform CT. then 

(CT (n) )(s) =s n (CT)(s) (13.9) 

for n € N. (Compare this with the differentiation rule in the time domain in (12.10).) 
The proof of (13.9) is easy and follows just as in example 13.7 from formulas (13.7) 
and (8.17): 

(CT^)(s) = [r (n \e- st] j = (-1)" (t, (e~ st ) (n) ^ = s n (T, e~ st ) 

= s n (CT)(s). 

We know from example 13.5 that C8 = 1. From (13.9) it then follows that 
(£«<">(f))(j) = s\ in agreement with example 13.7. ^ 

Formula (13.9) can in particular be applied to a causal function / defining a 
distribution Tf , and so it is much more general than the differentiation rule in the 
time domain from theorem 12.7. We will give some examples. 

The Laplace transform F{s) of f(t) — e(t — 1) is given by F(s) = e~ s /s. Of 
course, the function e(t — 1) is not differentiable on R, but considered as a distribu¬ 
tion we have that e'(t — 1) = 8(t — 1). According to (13.9) with n — 1 one then 
obtains that (£8(t — l))(i) = s(Ce(t — l))(s) = e~ s . This is in accordance with 
example 13.6. Applying (13.9) for n e Nit follows that lC8 (n ~^(t — l))(i) = 
s"(Ce(t— l))(.s) = s n ~^e~ s . It is not hard to obtain this result in a direct way (see 
exercise 13.16). ^ 

For the (causal) function f(t ) = cos t one has (cos tf = 5(f) — sin/, considered as 
a distribution (see example 8.10). From formula (13.9) with n — 1 it then follows 
that (£(S(t) — sin/))(i) = s(£ cos t)(s). This identity can easily be verified since 
C8 = 1, (£sin/)(.r) = 1 /(s 2 + 1) and (Ccost)(s) = s/(s 2 + 1). ^ 

In example 13.8 we encounter a situation that occurs quite often: a causal func¬ 
tion /(/) having a jump at the point / = 0, being continuously differentiable 
otherwise, and defining a distribution Tf. Let us assume for convenience that 
/(0) = f (0T), in other words, let us take the function value at f = 0 equal to 
the limiting value /(0+). The magnitude of the jump at t = 0 is then given by 
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Laplace transform and 
convolution 


the value /(0). We moreover assume that the Laplace transforms of / and f' ex¬ 
ist (in the ordinary sense), and according to (13.8) we thus have CTf = Cf and 
CTp = Cf'. For the derivative T',- of /, considered as a distribution, one has, 
according to the jump formula (8.21), that T',. = f'(t) + /(0)<5(f), where f'{t) is 
the derivative of f(t) for / f 0. Hence, 

(CT’ f Xs) = (£/')(«) + fmCSKs). 

Since C8 = 1 it then follows from (13.9) that 
CC/)(5) = (£r})(s) - /(O) = *(£/)(*) - /(0), 

where we used CTt = Cf. Applying this rule repeatedly, we obtain for a causal 
function f(t) being n times continuously differentiable for t > 0 that 

0 Cf (n) ){s ) = s"(Cf)(s) - £V _ */ ( * _I) (0). (13.10) 

*=l 

Here /w is the A'th derivative of f(t) for t ft 0 and it is assumed that all Laplace 
transforms exist in the ordinary sense. Formula (13.10) is used especially for solv¬ 
ing differential equations by means of the Laplace transform. In addition to an 
unknown function fit) satisfying a differential equation, only the values /®(0) 
(k = 0, 1, .... n — 1) are given (see chapter 14). 

We close with some elementary results on the Laplace transform of a convolution 
product of distributions. From section 9.3 it is known that the convolution product 
S * T exists for any distribution T and that 8 * T = T (see (9.19)). If the Laplace 
transform CT of T exists, then this implies that C(8 * T) = CT, and since C8 = l 
we thus see that C(8 * T) = C8 ■ CT. This shows that in this particular case the 
convolution theorem for the Laplace transform also holds for distributions. Using 
the same method one can verify in a direct way the convolution theorem for distri¬ 
butions for a limited number of other cases as well. Let us give a second example. 
In (9.20) we saw that 8' * T = T 1 for a distribution T. Since (CT')(s) = s(CT)(s), 
it follows that C(8' * T)(s) = s(CT)(s). But (C8')(s) = t and so we indeed have 
C(8' * T) = C8' ■ CT. 

In most cases these simple results on the Laplace transform of convolution prod¬ 
ucts will suffice in the applications. 


13.4.2 Mathematical treatment* 

In section 13.4.1 it was pointed out that the definition in (13.7) of the Laplace trans¬ 
form of a distribution gives rise to two problems. First of all it was noted that the 
function e~ st is not an element of the space S. For Ret <0, for example, we have 
that e~ st -*■ oo for t —> oo. This problem is solved by simply allowing a larger 
class of functions (f> in (13.5). To this end we replace S by the space £ defined as the 
set of all C°°-functions on R (this space of arbitrarily often differentiable functions 
has previously been used towards the end of section 9.3). As a consequence of this 
change, the number of distributions for which we can define the Laplace transform 
is reduced considerably. However, this is unimportant to us, since we will only need 
a very limited theory of the Laplace transform of distributions (in fact, only the delta 
function and its derivatives are needed). Note that the complex-valued function e~ st 
indeed belongs to £. 

The second problem involved finding the analogue of the notion of causality for 
a distribution. This should be a distribution being ‘zero for t < O’. If the function 
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EXAMPLE 

EXAMPLE 


DEFINITION 13.2 
Laplace transform of a 
distribution 


EXAMPLE 


EXAMPLE 


EXAMPLE 


/ in (13.5) is causal and we choose a f e S such that fit) = 0 for f > 0, then it 
follows that 

/ oo roo 

f(t)4>(0 dt = J f(t)<P(t) dt — 0. 

We can now see that the definition of a causal distribution should be as follows. 

Let T be a distribution. We say that T = 0 on the interval (—oo, 0) when (T,<j>) = 0 
for every f e S with f(t) = 0 for t > 0. Such a distribution is called a causal 
distribution. 

If / is a causal function defining a distribution Tf, then Tf is a causal distribution. 
This has been shown earlier. ^ 

The delta function 5 is a causal distribution since (5, f) = f(0) = 0 for f e S with 
f(t) = 0 for t > 0. More generally we have that the delta function 8(t — a) with 
a > 0 is a causal distribution. In fact, it follows for f e S with fit) = 0 for t > 0 
that (5(f — a), f) = f(a) = 0 since a > 0. ^ 

The causal distributions, which moreover can be defined on the space £, will now 
form the set of distributions for which the definition of the Laplace transform of a 
distribution in (13.7) makes sense. 

Let T be a distribution which can be defined on the space £ of all C°° -functions on 
R. Assume moreover that T is causal. Then the Laplace transform U = CT ofT is 
defined as the complex function U (s) = (T (0, e ~ st ). 

As was noted following (13.7), the Laplace transform U (s) of a distribution is a 
complex function. From definition 13.2 we see that U(s) is defined on the whole 
of C. One even has that U (s) is an analytic function on C! The proof of this result 
is outside the scope of this book; we will not need it anyway. Also, in concrete 
examples this result will follow from the calculations. We will give some examples. 

The delta function is a causal distribution which can be defined on the space £, since 
(5, f) = f(0) has a meaning for every continuous function f (see section 8.2.2). 
Hence, the Laplace transform of <5 is well-defined and as in example 13.5 it follows 
that £5 = 1. Note that the constant function 1 is an analytic function on C. ^ 

Consider the delta function 8(t — a) at the point a for a > 0. Then C8(t — a) is 
again well-defined and (C8(t — a))(s) = e~ as (see example 13.6). This is again an 
analytic function on C. ^ 

For all derivatives of the delta function 5(f) the Laplace transform is also well- 
defined and as in example 13.7 it follows that (CS^ n Ht))(s) = s". The function s n 
is again an analytic function on C. ^ 

Many of the properties that hold for the Laplace transform of functions, can be 
translated into properties of the Laplace transform of distributions. The linearity and 
the differentiation rule for the Laplace transform of distributions have already been 
treated in section 13.4.1. The shift property in the j-domain and the scaling rule 
also remain valid for distributions, but because of the limited applicability of these 
rules, we will not prove them. As an illustration we will prove the shift property in 
the time domain here. 

Let T (t) be a distribution whose Laplace transform U (s) exists (so T is causal 
and defined on £). Then one has for a > 0 that 


Shift in the time domain 


(CT (t — a))(s) = e~ as U(s), 


( 13 . 11 ) 
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where T(t — a) is the distribution shifted over a (see definition 9.2). In order to 
prove this rule, we first show that T(t — a) is causal. So let ip e S with 0(f) = 0 for 
t > 0. Then ( T(t — a), (p(t)) = ( T(t ), <j>(t + a)) = 0 for t > 0 since T is causal 
and t + a > 0 (because a > 0 and t > 0). Hence, T(t — a) is causal. It also follows 
immediately that T(t — a) is defined on £, since T is defined on £ and the function 
xjf(t) = <p(t + ct ) belongs to £ when 0(f) e £. Hence, the Laplace transform of 
T(t — a) exists and from definition 13.2 it then follows that 

(CT(t - a))(s) = (T(t - a), e~ st ) = e~ s(t+a)] j 

= e~ as (no, e _sr ) = e~ as U(s), 

proving (13.11). 

EXAMPLE We know that C8 = 1. From (13.11) it then follows that (C8(t - a))(s) = e~ as , 

which is in accordance with example 13.6. ^ 

Some simple results on the convolution in relation to the Laplace transform of 
distributions have already been treated in section 13.4.1. As for the Fourier trans¬ 
form, there are of course general convolution theorems for the Laplace transform of 
distributions. A theorem comprising all the examples we have treated earlier reads 
as follows. 

THEOREM 13.6 Let S and T be causal distributions which can be defined on the space £. Then S*T 

Convolution theorem is a causal distribution which can again be defined on the space £ and C(S * T) = 

CS- CT. 

Proof 

The proof that S * T is a causal distribution which can be defined on £ is be¬ 
yond the scope of this book. Assuming this result, it is not hard to prove that 
C(S * T) = CS ■ CT. For s € C one has C(S * T)(s) = ((S * T)(t ), e~ st ) = 

(s(t), (r(t), e~ s ^ r+t A\, where we used definition 9.3 of convolution. It then fol¬ 
lows that C{S * T)(s) = (S( t), (r (t), e~ st e~ sr )). For fixed r, the complex number 
e~ ST does not depend on t. The number e~ ST can thus be taken outside of the ac¬ 
tion of the distribution T(t). This results in C(S*T)(s) — [S( t), [T (t), e~ st ) e~ sr ). 
But now {T(t), e~ st ) is, for fixed t, a complex number which does not depend on r 
and so it can be taken outside of the action of the distribution S(z). This gives the 
desired result: C(S * T)(s) = (S(r), e~ ST )(T(t), e ~ st ) = (CS)(s) ■ (CT)(s). g 

All the examples in section 13.4.1 satisfy the conditions of theorem 13.6. This 
is because the delta function and all of its derivatives are causal distributions which 
can be defined on the space £. 

EXERCISES 

13.15 Consider the function f a (t) = ae~ a, e(t) for a > 0 and let F a (s) = (Cf a ){s). 
a Sketch the graph of f a (t) and show that f a (f)dt = 1. 

b Show that liniu-^oo f a ( t) = 0 for every t > 0 and that linin-^oo f a (f) = oo for 
t = 0. Conclude from parts a and b that the function f a (t) is an approximation of 
the delta function 5(f) for a —> oo. 

c Determine F a (s ) and calculate linta-^oo F a (s). Explain your answer. 

13.16 Use formula (13.7) to determine the Laplace transform of the nth derivative 
8^ n Ut — a) of the delta function at the point a for a > 0. 


13.17 


Show that the Laplace transform of distributions is linear. 
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13.18 


13.19 


13.20 


13.21* 


THEOREM 13.7 

Fundamental theorem of the 
Laplace transform 


Verify the convolution theorem of the Laplace transform for 8^ m - * T (m e N), 
where T is a distribution whose Laplace transform exists. Hence, show in a direct 
way that £{8 {m) * T) = C8 ( ' n) ■ CT. 

Determine the Laplace transform of the following distributions (and combinations 
of functions and distributions): 
a 8(t) + sin t, 
b 8'(t) + 38"(t), 
c e(f) + 8{t — 2) + 2/5" (f — 4), 
d 8°\t)*8(t -a). 

Determine a combination of functions and/or distributions whose Laplace transform 
is given by the following complex functions: 
a F(s) = s + 3 — e~ 2s , 
b F{s) = (s- 2) 2 + 1/C s - 2), 
c F(s ) = e~ 2s /(s~ + 1) + e~ 2s s 3 , 
d F(s) = s 2 /(s 2 + 1). 

Let T be a distribution with Laplace transform U and consider for a > 0 the shifted 
distribution T(t — a) (see definition 9.2). Verify the convolution theorem for T(t) * 
8(t — a). (Hint: see exercise 9.20.) 


13.5 The inverse Laplace transform 

In this final section on the theory of the Laplace transform we consider the problem 
of the inverse of the Laplace transform. We start with the proof of the fundamental 
theorem of the Laplace transform, which describes how a function /(f) in the time 
domain can be recovered from its Laplace transform F(s). By using the connec¬ 
tion between the Fourier and the Laplace transform, the proof of the fundamental 
theorem is quite easy. 

Let f(t) be a piecewise smooth (and causal) function of exponential order a e R. 
Let F(s ) be the Laplace transform of fit). Then one has for t > 0 and s = a + iw 
with a > a that 

lim ±- f A F(s)e s ' d<o= l - ( f(t+ ) + fit-)). (13.12) 

A —>oo In J—A 2 

Proof 

Write s = a + ia> and define g(f) = e{t)f {t)e~ at . Note that g(t) is absolutely 
integrable for a > a since /(f) is of exponential order a e M (see the proof of 
theorem 12.3). The Fourier transform of g(f) thus exists for a > a and according 
to (12.2) we then have F(s) — ( J-g){a >). Since / is piecewise smooth, g is also 
piecewise smooth and, moreover, absolutely integrable. The fundamental theorem 
of the Fourier integral (theorem 7.3) can thus be applied to the function g and since 
(J-g)(a>) = F(a + ia>), it then follows from (7.9) that 

1 • 1 

— / F{o + im)e lmt dot = - (g(f+) + git-)). 

2tt J—oo 2 

Here the integral should be interpreted as a Cauchy principal value, hence as 
lim^oo f^ A .... For f > Owe have g(f+) = e(f+)/(f+)e _<Tf+ = fit+)e~ a ' 
and similarly git—) = flt—)e~ at , which leads to 

\ C A • 1 

lim — / F(o + ia>)e uot dot = - (/(f+) + fit— )) e at . 

A—>oo 2n J—a 2 
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THEOREM 13.8 

The Laplace transform is 

one-to-one 


Inversion theorem 
Inversion formula 
Inverse Laplace transform 


Step 1 


If we now multiply the left- and right-hand sides by e al , then (13.12) indeed follows, 
valid for a > a and t > 0. g 

Note that in (13.12) we only integrate over a> and that the value of a is irrelevant 
(as long as a > a). As for the Fourier transform (see section 7.2.1), the fundamental 
theorem immediately implies that the Laplace transform is one-to-one. 

Let f(t) and g(t ) be two piecewise smooth functions of exponential order and let 
F{s) and G(s) be the Laplace transforms of f(t) and g(t). When F(s ) = G(s) in a 
half-plane Re ,s > p, then f(t ) = g(t) at all points where f and g are continuous. 

Proof 

Let t e R be a point where both / and g are continuous. Since F(s) = G(s) for 
Re s > p, it follows from the fundamental theorem that (in the following integrals 
we have s — a + ia> with cr > p) 

1 M i M 

/(f) = lim — / F(s)e st da>= lim — / G(s)e st da> = g{t). 

A—>oo 2 tt J-a A—>oo 2n J-a 

■ 

This theorem is often used implicitly if we are asked to determine the function 
/(f) whose Laplace transform F(s ) is given. Suppose that an /(f) is found within 
the class of piecewise smooth functions of exponential order. Then we know by 
theorem 13.8 that this is the only possible function within this class, except for 
a finite number of points on a bounded interval (also see the similar remarks on 
the uniqueness of the Fourier transform in section 7.2.1). Without proof we also 
mention that the Laplace transform of distributions is one-to-one as well. 

Theorem 13.7, and the resulting theorem 13.8, are important results in the the¬ 
ory of the Laplace transform. As for the Fourier transform, theorem 13.7 tells us 
precisely how we can recover the function /(f) from F(s). Obtaining / from F is 
called the inverse problem and therefore theorem 13.7 is also known as the inversion 
theorem and (13.12) as the inversion formula. We will call the function / the inverse 
Laplace transform of F. Still, (13.12) will not be used for this purpose. In fact, cal¬ 
culating the integral in (13.12) requires a thorough knowledge of the integration of 
complex functions over lines in C, an extensive subject which is outside the scope 
of this book. Hence, the fundamental theorem of the Laplace transform will not be 
used in the remainder of this book, except in the form of the frequent (implicit) ap¬ 
plication of the fact that the Laplace transform is one-to-one. Moreover, in practice 
it is often a lot easier to determine the inverse Laplace transform of a function F(s) 
by using tables, applying the properties of the Laplace transform, and using partial 
fraction expansions. 

Partial fraction expansions have been treated in detail in section 2.2 and will be 
used to obtain the inverse Laplace transform of a rational function F(s). It will 
be assumed that F(s) has real coefficients; in practice this is usually the case. We 
will now describe in a number of steps how the inverse Laplace transform of such a 
rational function F(s) can be determined. 

If the degree of the numerator is greater than or equal to the degree of the denomina¬ 
tor, then we perform a division. The function F(s) is then the sum of a polynomial 
and a rational function for which the degree of the numerator is smaller than the 
degree of the denominator. The polynomial gives rise to distributions in the inverse 
Laplace transform since s" — (,C& (n \t))(s). 


EXAMPLE 


We want to determine the function/distribution f(t) having Laplace transform 
F{s) — (s 3 — s~ + s)/(s 2 + 1). Since the degree of the numerator is greater than 
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Step 2 


Step 3 


EXAMPLE 


EXAMPLE 


EXAMPLE 


Step 4 


the degree of the denominator, we first divide: F(s) = s — 1 4- 1/(5“ + 1). Now 
C8 — 1, C8' = s and (£ sin 0(5) = l/(5 2 + 1), so f(t) = 8'it) — 8(t) + sin t. ^ 

From step 1 it follows that henceforth we may assume that F(s) is a rational function 
for which the degree of the numerator is smaller than the degree of the denominator. 
From the results of section 2.2 it then follows that F(s) can be written as a sum of 
fractions of the form 

A Bs + C 

-r and - j > 

(5 + a) k (s~ + 2 bs + c)‘ 

with k,l e N and where all constants are real and s 2 + 2 bs + c cannot be factorized 
into factors with real coefficients. This latter fact means that the discriminant of 
5“ + 2bs + c is negative. We will now determine the inverse Laplace transform for 
each of these fractions separately. 

From table 7 we immediately obtain the inverse Laplace transform of A/{s + a) k : 

{Ct k ~ X e~ a, ){s) = (k ~ . (13.13) 

is+a) k 


Determine the function /(f) with (Cf(t))(s) = F(5) = l/(5 2 + 35 + 2). The 
discriminant of the denominator is positive and so it can be factorized into two real 
linear factors: 5 2 + 35 + 2 = (s + 1)(5 + 2). From a partial fraction expansion it 
follows that Fis) = 1/(5 + 1) — 1/(5 + 2). Hence, /(f) = e~‘ — e~ 2t . Compare 
this with the use of the convolution theorem in exercise 13.2. ^ 

Determine the inverse Laplace transform /(f) of F{s) = l/(5 3 + 4.v 2 + 35). Note 
that 5 3 + 45 2 + 3.s- = 5(5 2 + 4.v + 3) and that the quadratic form has a positive 
discriminant; it follows that 5 3 + 45 2 + 35 = 5(5 + 3 )(5 + 1) and from a partial 
fraction expansion it follows that 

1 1 1 

F(s) = — +-. 

35 6(5 + 3) 2(5 + 1) 

From (13.13) we then obtain that /(f) = (2 + e _3f — 3e~')/6. ^ 

The denominator of the function F{s) = l/((5 + 1) 3 (5 — 2) 2 ) has two multiple 
zeros. The partial fraction expansion of this function will take some effort, but will 
eventually result in 


1 

5-2 

From (13.13) we then see that the inverse Laplace transform of F(s) is given by 
fit) = e -'( 3 f 2 + 2f+ l)/27 + f> 2, (f- l)/27. ^ M 

In order to determine the inverse Laplace transform of (Bs + C)/(5 2 + 2 bs + c) 1 , 
we complete the square in the denominator: 5 2 + 2 bs + c = (5 + b ) 2 + (c — b 2 ). 
For convenience we write the positive constant c — b 2 simply as c 2 (for some new 
constant c), which means that we want to determine the inverse Laplace transform 
of the function 


Fis) = 


27 V (5 + l) 3 + (5 + l) 2 + 5 + 1 + is - 2) 2 


Bs + c 

((5 + b) 2 + c 2 ) 1 


for I e N. 


(13.14) 
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EXAMPLE 


EXAMPLE 


EXAMPLE 


For / = 1 we obtain the inverse Laplace transform of this function from (13.14) by 
taking a suitable linear combination of the following results from table 7: 


Determine the function f(t) with Laplace transform F{s) = l/(4 2 — 2s + 17). 
The discriminant of the denominator is negative and so we complete the square: 
s 2 — 2s + 17 = (s — l) 2 + 16. From (13.15) it then follows that /(f) = ( e l sin4f)/4 
(also see exercise 12.19g). ^ 

Determine the function/(f) with Laplace transform F(s) = l/(s(i ,2 + l)). Apartial 
fraction expansion leads to F(s) = 1/s — s/(s 2 + 1) = (Cl)(s) — {C cos t){s). From 
a very simple case of (13.15) it then follows that/(f) = 1— cosf. In example 12.13 
we used the integration rule to prove this. ^ 

Determine the function /(f) with Laplace transform F(s ) = 1 /((s 2 + 4)(s 2 + 16)). 
Since F(s) is a function of s 2 , we put y = s 2 and apply partial fraction expansion 
to the function l/((y + 4)(y + 16)), resulting in l/(12(y + 4)) — l/(12(v + 16)). 
Hence, F(s ) = l/(12(s 2 + 4)) — l/(12(i 2 + 16)) and then it again follows from a 
simple case of (13.15) that /(f) = (sin2f)/24 — (sin4f)/. 
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13.22 


13.23 


Writing — (s + 2) 2 + 4 = — ((s + 2) 2 + 4) + 8 will reveal that 

d s + 2 1 i 8 

ds 0 + 2) 2 + 4 “ “ CsT 2) 2 + 4 + ((5- 4- 2) 2 + 4) 2 

and thus 

d 1 ^ f d s + 2 1 \ —2 as — 4a + 8 b 

“ds 0 + 2) 2 +4 + \d~s (s + 2) 2 + 4 + (s + 2) 2 + 4/ “ ((s + 2) 2 + 4) 2 ' 

The right-hand side is equal to F(s) for a — —3 and b — —2 and hence 

d 1 d s + 2 2 

F(s) = -3--x-2--=-=-. 

ds (s +2)2+4 ds (s + 2)2+4 (s + 2) 2 + 4 

Using (13.15) and the differentiation rule in the ^-domain we can then finally de¬ 
termine the inverse Laplace transform: /(f) — (3te~ 21 sin2f)/2 + 2te~ 2 ' cos 2 1 — 
e~ 2 'sin2t. ^ 

EXERCISES 

Determine the inverse Laplace transform f(t) of the following complex functions: 
a s/(s 2 + 5i + 6), 
b \/(s 2 + 6s + 10), 
c s/((s - l)(s +2)(s + 3)), 
d (i 2 + 1)/((s 2 - 4)(s 2 - 1)), 
e (i 2 + 7)/((j + 1) 2 (i _ 1))i 
f 1 / (s 2 — l) 2 , 
g (i 3 +4)/((s 2 + 4)U-l)), 
h e~ 2s {s b + s 2 - i)/^ 2 ^ 2 _ D). 

For integer k we define Ff,(s) = 1 /(s k — 1). Determine the inverse Laplace trans¬ 
form //.(f) of 7+(i) for k = 1, 2, 3, 4 and —1. 


SUMMARY 

First, a number of additional properties of the Laplace transform were treated in this 
chapter. 

It was shown that the convolution product of two causal functions / and g is 
again a causal function and that, under certain conditions, the convolution theorem 
holds: C(f * g)(s ) = (Cf)(s) ■ (Cg)(s). 

In general one has for the Laplace transform F(s) that lim^oo F(s) = 0. If 
/(f) is a piecewise smooth function, then lim. s _>.c>o sF(s) = /(0+) according to 
the initial value theorem. If the final value lini/_*. 00 /(f) = /(oo) exists, then the 
final value theorem states that lim s ^o sF(s ) = /(oo). 

For a periodic function /(f) with period T there is a simple relationship between 
F(s) and the Laplace transform of the function restricted to one period. When 
/(f) = /(f) — e(f — T)f(t — T) has Laplace transform <t>(.s), then 

<t>Cs) r T 

F(s) = - '-y with <&(*)=/ / (t)e~ 1 dt. 

1 - e SI Jo 

For distributions T the Laplace transform TIT is defined as the complex func¬ 
tion (LT)(s) = (T (f) , e~ s, y One then has, for example, that £8 — 1 and {C8(t — 
n))(i) = e~ as . The differentiation rule for distributions reads as follows: 
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)(s) — s m (CT)(s) and so one has in particular (CS^)(s) = s m . For cer¬ 
tain classes of distributions the convolution theorem remains valid, so C(S * T) = 
CS ■ CT. One has, for example, that £{8 * T) = CT and C(&' * T) = s(CT)(s). 

From the fundamental theorem of the Fourier transform one immediately obtains 
the fundamental theorem of the Laplace transform. From this fundamental theorem 
the uniqueness of the Laplace transform follows: when /(f) and g(t ) are two piece- 
wise smooth functions of exponential order and F(s) — G(s) in a certain half-plane 
in C, then /(f) = g(t) at all points where / and g are continuous. For distributions 
the uniqueness of the Laplace transform remains valid. In practical problems the 
inverse Laplace transform is usually determined by using tables, properties of the 
Laplace transform and partial fraction expansions. 


13.24 

13.25 

13.26 

13.27 

13.28 


SELFTEST 


Let /(f) be the function with Laplace transform F(s) = s/(s 2 + 4)~. 
a Determine a convolution product (g * h)(t) with Laplace transform F(s). 
b Determine /(f) by calculating the convolution from part a. 
c Calculate the derivative of l/(s 2 + 4) and use the differentiation rule in the 
^-domain to determine /(f) once again. 

Consider the function /(f) = t — e(t — 2)(t — 2) having Laplace transform F(s). 
a Determine lim^^o sF(s) and lim^oo sF(s) without calculating F(s). 
b Calculate F(s ) and verify the results from part a. 

Let /(f) be a function with Laplace transform F(s). Determine the function /(f) 
for each of the functions F(s) given below and verify the final value theorem, or 
explain why the final value theorem cannot be applied, 
a F(s) = (s + 5)/(s(s 2 + 2s + 5)). 
b F(s) = s 2 /({s 2 — l)(i 2 +4)). 

Let /(f) be the (causal) periodic function with period 2 defined for 0 < f < 2 by 


/(*) = 


f 2 forO < f < 1, 
0 for 1 < f < 2. 


a Sketch the graph of / and show that /(f) = f 2 (e(f) — e(t — 1)) for 0 < f < 2. 
b Determine ( Cf)(s ) = F(s). 

Determine the inverse Laplace transform /(f) of the following complex functions 
F(s): 

a F(s) = (1 - e- 3s )/Cs(.s + 1)), 
b F(s) = (s 2 + l)/(.s 2 (s - l) 2 ), 
c F(s) = (1 + e^Cs 5 - 4/ - 8* + 64))/(s 2 (s 2 + 4)). 
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CHAPTER 14 


Applications of the Laplace transform 


INTRODUCTION 


The greater part of this chapter consists of section 14.1 on linear time-invariant 
continuous-time systems (LTC-systems). The Laplace transform is very well suited 
for the study of causal LTC-systems where switch-on phenomena occur as well: at 
time t = 0 ‘a switch is thrown' and a process starts, while prior to time t = 0 the 
system was at rest. The input u(t) will thus be a causal signal and since the system 
is causal, the output y(t) will be causal as well. Applying the Laplace transform 
is then quite natural, especially since the Laplace transform exists for a large class 
of inputs u(t ) as an ordinary integral in a certain half-plane Re.v > p. This is in 
contrast to the Fourier transform, where distributions are needed more often. For 
the Laplace transform we can usually restrict the distribution theory to the delta 
functions S(t — a) with a > 0 (and their derivatives). As in chapter 10, the response 
h(t) to the delta function <5(0 again plays an important role. The Laplace transform 
H(s) of the impulse response is called the transfer function or system function. An 
LTC-system is then described in the j-domain by the simple relationship L(s) = 
H(s)U(s ), where LOs - ) and U(s) are the Laplace transforms of, respectively, the 
output y(t ) and the input u{t) (compare this with (10.6)). 

In this chapter we will mainly limit ourselves to systems described by ordinary 
linear differential equations with constant coefficients and with initial conditions all 
equal to zero (since the system is at rest at t = 0). The transfer function H(s) is 
then a rational function of s and the impulse response can thus be determined by a 
partial fraction expansion and then transforming this back to the time domain. As 
we know, the response y(t) of the system to an arbitrary input u(t) is given by the 
convolution of h(t) with u(t) (see section 10.1). In order to find the response y (t) 
for a given input u(t), it is often easier first to determine the Laplace transform U (s) 
of u(t) and subsequently to transform H(s)U(s) back to the time domain. This is 
because U(s), and hence Y(s) = H(s)U(s) as well, is a rational function for a large 
class of inputs. The inverse Laplace transform y(t) of Y (s) can then immediately be 
determined by a partial fraction expansion. This simple standard solution method is 
yet another advantage of the Laplace transform over the Fourier transform. 

If we compare this with the classical method for solving ordinary linear differen¬ 
tial equations with constant coefficients (using the homogeneous and the particular 
solution), then the Laplace transform again has the advantage. This is because it 
will turn out that the Laplace transform takes the initial conditions immediately into 
account in the calculations. This reduces the amount of calculation considerably, 
especially for higher order differential equations. As a disadvantage of the Laplace 
transform, we mention that in general one cannot give a straightforward interpreta¬ 
tion in terms of spectra, as is the case for the Fourier transform. 

For the differential equations treated in section 14.1, all the initial conditions will 
always be zero. In section 14.2 we will show that the Laplace transform can equally 
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well be applied to ordinary linear differential equations with constant coefficients 
and with arbitrary initial conditions. In essence, nothing will change in the solution 
method from section 14.1. Even more general are the systems of several coupled 
ordinary linear differential equations with constant coefficients from section 14.3. 
Again these can be solved using the same method, although in the s -domain we 
have not one equation, but a system of several equations. For convenience we con¬ 
fine ourselves to systems of two differential equations. Finally, we briefly describe 
in section 14.4 how the Faplace transform can be used to solve partial differential 
equations with initial and boundary conditions. By applying the Faplace transform 
to one of the variables, the partial differential equation becomes an ordinary differ¬ 
ential equation, which is much easier to solve. 

FEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know the concept of transfer function or system function of an LTC-system 

- can determine the transfer function and the impulse and step response of a causal 
LTC-system described by an ordinary linear differential equation with constant 
coefficients 

- know the relation between the input and the output in the s -domain using the 
transfer function and can use it to calculate outputs 

- can verify the stability using the transfer function 

- can apply the Laplace transform in solving ordinary linear differential equations 
with constant coefficients and arbitrary initial conditions 

- can apply the Laplace transform in solving systems of two coupled ordinary linear 
differential equations with constant coefficients 

- can apply the Laplace transform in solving partial differential equations with initial 
and boundary conditions. 


14.1 Linear systems 

14.1.1 The transfer function 

The basic concepts from the theory of LTC-systems (linear time-invariant continuous¬ 
time systems) have been treated extensively in chapter 1 and section 10.1. Let us 
summarize the most important concepts. 

An LTC-system L associates with any input u(t) an output y(t). One also calls 
y(t) the response to u(t). When hit) is the impulse response, that is, h(t) is the 
response to S(t), then it follows for an arbitrary input u(t) that 

yit) = Lu{t) = ih*u){t) (14.1) 

(see (10.3)). An LTC-system is thus completely determined by the impulse response 
h{t). Besides the impulse response we also introduced in section 10.1 the step re¬ 
sponse ait), that is to say, the response of the system to the unit step function e)t). 
We recall that hit) is the derivative of a it) (considered as a distribution, if neces¬ 
sary). Using the convolution theorem of the Laplace transform one can translate 
relation (14.1) to the s-domain. To this end we assume, as in section 10.2, that for 
the LTC-systems under consideration we may apply the convolution theorem, in the 
distribution sense if necessary. If U(s), Tfs) and His) are the Laplace transforms 
of uit), yit) and hit) respectively, then it follows from the convolution theorem that 


Yis) = His)Uis). 


(14.2) 
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DEFINITION 14.1 

System function 
Transfer function 

EXAMPLE 14.1 


Switched-on system 


EXAMPLE 14.2 


The function H(s) plays the same important role as the frequency response from 
chapter 10. 

Let h{t ) be the impulse response of an LTC-system. Then the system function or 
transfer function H(s) of the LTC-system is the Laplace transform of h(t) (in the 
distribution sense, if necessary). 

Consider the integrator from example 10.3 with impulse response h(t ) = e(t). The 
Laplace transform of e(t) is 1/5 (see table 7) and so H(s) — 1/5. Hence, the 
response y(t) of the integrator to an input u{t ) is described in the 5-domain by 
Y(s) = U(s)/s. + 

In practical situations we are usually dealing with systems where switch-on phe¬ 
nomena may occur: at time t = 0 a system, being at rest, is switched on. The inputs 
are then causal and when the LTC-system is causal, then the output will be causal as 
well (theorem 1.2). In this chapter we will limit ourselves to causal LTC-systems 
and, moreover, we will always assume that all inputs u(t), and thus all outputs y(t) 
as well, are causal: u(t) — y(t) = 0 for t < 0. Here we will also admit distri¬ 
butions ‘which are zero for t < O’: the delta functions 8(t — a) with a > 0 and 
their derivatives (see section 13.4). In particular the impulse response will also be 
a causal signal. If now the Laplace transform H(s) exists in a certain half-plane 
Re s > p with p < 0, then we can take s = ico and since h(t) is causal, it then 
follows that 

poo poo 

H(ico) = (Ch)(ia>) = / h(t)e~ iwt dt = / h(t)e~ iwt dt = (Th^co). 

JO J—o o 

Hence, in this case we see that the frequency response from section 10.2 is given by 
H(ico). Many Laplace transforms only exist in a half-plane contained in Re s > 0. 
Of course, substituting s = ico is then not allowed. Because of this, the term ‘fre¬ 
quency response’ for the function H(s) is misplaced: in general H(s) is a complex 
function having no interpretation in terms of frequencies. 

Consider the integrator from example 10.3 with system function H(s) = 1/5 (for 
Re 5 > 0). The frequency response is not given by the function 1 /ico, but by 1 /ico + 
trSfco) (see example 10.4). ^ 

In section 10.3 we already noted that a large and important class of LTC-systems 
occurring in practice (such as RLC-networks) can be described by ordinary linear 
differential equations with constant coefficients of the form (10.9) (also see (14.5)). 
From now on we confine ourselves to such systems. In section 14.1.2 we will first 
explain the fundamental principle underlying the application of the Laplace trans¬ 
form to linear differential equations with constant coefficients. In essence, this prin¬ 
ciple remains unchanged throughout the remainder of this chapter. 


14.1.2 The method of Laplace transforming 

Using an elementary example we will illustrate how the Laplace transform can be 
used to obtain solutions to linear differential equations with constant coefficients. 
Moreover, we will show the difference between the method using the Laplace trans¬ 
form and the ‘classical’ solution method using the homogeneous and particular so¬ 
lutions. This classical solution method has already been explained in section 5.1 and 
can also be found in many introductions to this subject. In the following example 
we first solve a certain initial value problem using the classical method. 
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EXAMPLE 14.3 


EXAMPLE 14.4 


Consider for the unknown function y = y{t) the initial value problem 

y" -y = 2 1 , (14.3) 

y( 0) = y'(0) = 0. (14.4) 

The corresponding homogeneous equation y" — y = 0 has characteristic equation 
X 2 — 1 = 0 and so X = ±1. Hence, the solution y^ of the homogeneous equation 
is V’h(f) = ae’ + Pe ~', where a and p are arbitrary constants. To find a particular 
solution yp, we try Vp(f) = bt + c. Substituting this into (14.3) gives c = 0 and 
b = — 2. The general solution is thus 

y(t) = yh(0 + y p (t) = ae' + pe~' - 21. 

Substituting the initial values (14.4) gives a + p = 0 and a — p — 2 = 0. Solving 
this system of two equations in the two unknowns a and p we obtain that a = 1 and 
p = — 1. The solution to the initial value problem is thus given by 

y(t) = e r — e~‘ — 2 1 . 

◄ 

Characteristic for this classical method is the fact that we first determine the gen¬ 
eral solution to the differential equation ( y(t ) in example 14.3) and then determine 
the unknown constants in the general solution from the initial values (a and fi fol¬ 
low from y(0) and y'(()) in example 14.3). For an mth order linear differential equa¬ 
tion with constant coefficients it is known that a solution is uniquely determined by 
specifying (for example) m initial conditions (say y(0), ..., y^ m ~ 1 *(())). With the 
m initial conditions one can determine the m unknown constants in the general so¬ 
lution, by solving a system of m linear equations in m unknowns. For m > 3 this 
is a tedious calculation. Another disadvantage of the classical method is finding a 
particular solution. This is not always easy and may again require some tedious cal¬ 
culations. We will now use the Laplace transform to solve the initial value problem 
from example 14.3. 

Apply the Laplace transform to both sides of the differential equation (14.3). As¬ 
sume that T(i) = (yCy)!^) exists in a certain half-plane and that moreover the 
differentiation rule in the time domain ((12.10) or table 8) can be applied. Then 
(C(y" — y))0f) = s 2 Y(s) — T(i) and since (tCt)(s) = 1 /s 2 , the initial value prob¬ 
lem transforms into 

(i 2 - i)y(i) = 4- 

Note that instead of a differential equation for y(t) we now have an algebraic equa¬ 
tion for Y (s). Solving for Y (y) and applying a partial fraction expansion we obtain 
that 

2 2 2 

Y(s) = ^- 

s 2 (s 2 - 1) s 2 - 1 s 2 

The inverse Laplace transform y(t) of Y(s) follows from table 7: 
y (t) = 2 sinh t —2t = e' — e~ r — 2 1 . 

This is in accordance with the result from example 14.3. One can easily verify 
that the (causal) function y(t) satisfies the differential equation (14.3) and the initial 
conditions (14.4) (in general it is necessary to verify the result since a number of 
assumptions have been made in order to find the solution). ^ 
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Before we pass on to a comparison of the classical method with the method from 
example 14.4, we first summarize the most important steps of the solution method 
in example 14.4. 

Step 1 The Laplace transform is applied to the differential equation for y{t). Here we 

assume that the Laplace transform Y (.S' ) of the unknown function y(t) exists and that 
the differentiation rule in the time domain may be applied (either in the ordinary 
sense or in the sense of distributions). From the differential equation for y(t) we 
obtain an algebraic equation for Y (s) which is much easier to solve. 

Step 2 The algebraic equation in the .?-domain is solved for Y (s). 

Step 3 The solution we have found in the s-domain is then transformed back into the 

f-domain. For this we use tables, the properties of the Laplace transform and partial 
fraction expansions (see section 13.3). For the solution y(t) found in this way, one 
can verify whether it satisfies the differential equation and the initial conditions. 

This procedure is represented once more in figure 14.1. 



FIGURE 14.1 

Global procedure for the application of the Laplace transform in solving differential 
equations. 

If we now compare the method from example 14.4 with the classical method from 
example 14.3, then the advantage of the new method is not obvious yet. In general 
the advantages increase as the order of the differential equation increases and/or the 
right-hand side of the differential equation gets more complex. This is because the 
Laplace transform immediately leads to the desired solution, without the need to 
determine the general solution first. Solving a system of m linear equations in m 
unknowns afterwards (for an /nth order differential equation), is no longer necessary. 
This is caused by the fact that the Laplace transform immediately takes the initial 
conditions into account in the calculations (which is not very visible in example 14.4 
since we have initial conditions y (0) = y'(0) = 0). Besides this, finding a particular 
solution is not necessary since again the right-hand side of the differential equation 
is immediately taken into account in the calculations by the Laplace transform. 

14.1.3 Systems described by differential equations 

We now return to the general theory of the causal LTC-systems described by an 
ordinary linear differential equation with constant coefficients of the form 

d m y d m ~ l y dy 

elm - “1“ &m _1-r “h • • • "b &\ - + Cloy 

dt m m 1 dt m ~ x dt U - 

d n u d n ~ i u du 

= b >‘ ffpi + b n -1 + --- + bl— + b 0 u , (14.5) 

where n < m (also see (10.9)). Here u(t) is the input and y(t) the output or response. 
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EXAMPLE 14.5 


Initial rest 


At first sight one could think that any differential equation of the form (14.5) 
describes an LTC-system. This, however, is not the case since a differential equation 
on its own admits a large class of solutions. If sufficient additional conditions are 
supplied, for example initial conditions, then we may have reduced the number of 
solutions to just one, but in general the linearity property of linear systems (see 
definition 1.1) will not be fulfilled then. We illustrate this with an example. 

Consider the system described by the differential equation y" — y = u(t) (also see 
example 14.3) with two different initial conditions: 

y( 0 ) = 0 , y'( 0 ) = -2 and y( 0 ) = 0 , y'( 0 ) = 0 . 

The system having y(0) and y , (0) both equal to zero (the ‘right-hand system’) will 
be called a system at ‘initial rest’. Now take as input u(t ) = u\ (t) = 2 1 (as in 
example 14.3). The response yj (t) of these two systems is given by, respectively, 

yi ( t ) = — 2 1 and y\ (t) = e' — e -r — 2 1. 

For both situations we now take another input, namely u(t) = M 2 (l) — t ~. The 
response y 2 (t) of these two systems is then given by. respectively, 

y 2 (t) — 2e~ r — t~ — 2 and y 2 (l) = e' + e~ 1 — t~ —2. 

If we add the inputs, then the linearity of the system should guarantee that we obtain 
as output the sum of the separate outputs. We will verify this for both situations. 
The response V 3 (f) to the input U\(t) + w 2 (l) = 21 + t~ is given by, respectively, 

y 3 (/) = e‘ + e~’ — t 2 — 2t — 2 and V 3 it) = 2e~‘ — t~ — 2t — 2. 

We see that for the left-hand and right-hand system we have, respectively, 

y 3 (0 7 ^ yi it) + y 2 (f) and y 3 (f) = yi it) + y 2 ( 0 - 

◄ 

If we now look at how these differences in example 14.5 arise, then we observe 
that the right-hand system is at initial rest, that is to say, y(0) = y'{0) = 0. This 
is in contrast to the left-hand system, where _y'(0) = —2. For the solutions y j and 
y 2 one then has y^ (0) = vi,(0) = —2, so (yj + y 2 ) / (0) = —4, while y^(0) = —2. 
From this we immediately see that y 3 7 ^ yj + y 2 . 

For a system described by a differential equation of the form (14.5) we now define 
in general the condition of initial rest by 

y(0) = y'(0) = ... = y ( " !- 1 ) (0) = 0. (14.6) 

Example 14.5 suggests that the condition of initial rest is sufficient to ensure that 
a system described by a differential equation of the form (14.5) is linear. This is 
indeed the case. In fact, if an input ui(t) with response y\ it) satisfies differential 
equation (14.5), and an input i/ 2 (f) with response y 2 (f) also satisfies differential 
equation (14.5), then (ay\ + hy 2 )(0 will satisfy differential equation (14.5) for the 
input (au\ + Zzz/ 2 ) (?) because differentiating is linear. When, in addition, both yj 
and y 2 satisfy the condition of initial rest, then {ay\ + &y 2 )®( 0 ) = ay[* ) ( 0 ) + 
(k) 

by) ' (0) = 0 for k = 0. 1, ..., m — 1. Hence, ay j + by 2 also satisfies the condition 
of initial rest. Moreover, since solutions are uniquely determined by the m initial 
conditions in (14.6), it follows that (ayj + iy 2 )(r) must be the response to the input 
( 1 au\ + h« 2 )(f). Thus, the system is linear. 
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Step 1 


Step 2 


Step 3 


EXAMPLE 14.6 


For a causal LTC-system described by differential equation (14.5) and condition 
of initial rest (14.6) we now apply the Laplace transforming method from section 
14.1.2. 

Assume that the Laplace transform Y (s) of the unknown function y(t) exists and ap¬ 
ply the Laplace transform to all terms in the differential equation (14.5). We do this 
under the assumption that we may apply the differentiation rule (12.10) in the time 
domain. The (causal) function y{t) should then be m — 1 times continuously differ¬ 
entiable on R and should be differentiable on R. Note that in this case the 

conditions of initial rest are automatically satisfied since for k — 0, 1, • • •, m — 1 it 
follows from the continuity of y® that yW(0) = y^(0 — ) = 0 (for y® is causal). 
Similar remarks can be made for the function u(t). From (12.10) it then follows 
that, after Laplace transforming, the differential equation (14.5) is transformed into 
the algebraic equation 

a m s m Y(s) + • • • + fl lS y(s) + a 0 Y(s) = b„s n U(s ) + • • • + b 0 U(s), 
where U ( 5 ) is the Laplace transform of u(t). 

The algebraic equation in the s-domain is solved for Y ( 5 ). Using the polynomials 
A(s) = ajfiS T a m — {S + ■ ■ ■ 4- a\s -(- ao , 

B(s) = b n s n + b n -\s n ~ X +---+b x s + b 0 , (14.7) 

we can write the algebraic equation for Y (s) as A(5)F(s) = B(s)U ( 5 ). Solving for 
T(i) gives 

B(s) 

Y(s) = -pr-U(s). (14.8) 

A(s) 

The function y{t) we are looking for is the inverse Laplace transform of T(s). In 
many cases U ( 5 ) will be a rational function with real coefficients and the differential 
equation (14.5) will have real coefficients as well. It then follows from (14.8) that 
Y ( 5 ) is also a rational function with real coefficients. The partial fraction expansion 
method from section 13.3 can then be applied. One can then verify whether the 
solution y(t) we have found satisfies both the differential equation and the initial 
conditions. 


A system satisfying the condition of initial rest is described by the differential equa¬ 
tion y" — 3y , + 2y = u{t). We want to determine the response to the signal u(t) — t. 
Let Y(s ) be the Laplace transform of y(t). Since ( Ct)(s ) = 1 /s~, it follows that 
(s 2 — 3s + 2)T(y) = 1 /s 2 , or 

1 

s 2 (s 2 — 3s + 2) 

But s 2 — 3s + 2 = (5 — l)(s — 2) and a partial fraction expansion gives 

1 13 1 

Y(s) =-+ — + —X - . 

4(5-2) 5-1 45 25 2 

From table 7 we obtain y(f) = (e 21 — 4e' + 3 + 2f)/4. It is easy to check that y(t) 
satisfies the differential equation and the initial conditions. ^ 

By combining (14.8) and (14.2) we obtain the following important result for the 
transfer function: 


H(s) = 


B(s ) 

A (5)’ 


(14.9) 
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EXAMPLE 14.7 


EXAMPLE 14.8 


where B(s) and A(s) are the polynomials from (14.7). These two polynomials fol¬ 
low immediately from th e form of the differential equation: to get the transfer func¬ 
tion H (s) we do not have to calculate the impulse response h (t) explicitly! Equation 
(14.9) can also be obtained by taking the delta function S(t) as input in (14.8). Since 
in this case U(s) = (,CS)(s) = 1 and Y(s) = H(s) (definition 14.1), it then indeed 
follows from (14.8) that H(s) = B(s)/A(s). 

For the system in example 14.6 we take as input u(t) — S(t). Since CC5)(s) = 1, 
it follows from y" — 3y' + 2y = 8(t ) that ( s 2 — 3s + 2)H(s) = 1. The transfer 
function H(s) is thus given by H (s) = l/(s 2 — 3s + 2). Let us also determine the 
impulse response h(t). From the partial fraction expansion it follows that H(s) — 
1/fs — 2) — l/(s — 1) and so h(t) = e 2t — e l . It is easy to check that hit ) satisfies 
the differential equation, provided that we differentiate in the distribution sense! ^ 

In most of the engineering literature one is quite happy with the derivation of 
(14.9) based on the input 8(t). However, using example 14.7 it is easy to show that 
this derivation is not quite rigorous. For this we note that the impulse response h(t) 
from example 14.7 does satisfy h( 0) = 0, but that h'(0) does not exist. There is 
even a jump of h\t) at t = 0! This is because h'( 0—) = 0, since h' is causal, 
while /T (0T) = 1, since h’(t) = 2e 21 — e 1 for t > 0. Indeed, the function h'(t) 
must have a jump at t = 0, since otherwise no delta function would occur in the 
input. The conclusion must be that h(t) does not satisfy the condition of initial rest. 
This problem can be solved by applying the differentiation rule for distributions 
in (13.9) (or table 10). In fact, as we have already mentioned in example 14.7, 
differentiation should be taken in the distribution sense. The condition of initial rest 
is then irrelevant, since in general distributions have no meaning at all at t = 0. If 
we take as input u(t) = 8(t) in differential equation (14.5), then it indeed follows 
from (C8^)(s) = s k and the differentiation rule for distributions in (13.9) that 
H(s) — B(s)/A(s ), where B(s ) and A(s) are the polynomials from (14.7). 

Besides the impulse response one often uses the step response as well. Here 
similar phenomena occur as for the impulse response: although strictly speaking 
the differentiation rule in the time domain cannot be applied, one can again justify 
the result with the differentiation rule for distributions. We will not go into this any 
further and instead present another example. 

For the system from example 14.6 we take as input u(t) — e(t). Since CCe)(.s) = 
1/s, it follows from y" — 3y' + 2 y = e(t) that (s 2 — 3s + 2 )Y(s) — 1/j, so 
Y (s) = 1 /(s(s~ — 3s + 2)) (of course, this also follows straight from (14.2) since in 
this case U (.?) = (Cu)(s) = 1/s). A partial fraction expansion leads to 

1 1 1 

Y{s) = — +-, 

2s 2(s — 2) s- 1 

and so the step response is given by v(0 = (1 + e~‘ — 2e’)/2. Note that y(0) = 
y'(0) = 0 and that indeed y\t) = h(t), with h{t) the impulse response from exam¬ 
ple 14.7. Since in this case the impulse response had already been determined, the 
step response could of course also have been calculated using (14.1): 

y(t) = (h * e)(f) = [ h(r)dz= [ (e 2r — e T ) dr = i(l + e 2t — 2e’). 

Jo J 0 

Let us now assume in general that for a certain system the impulse response h(t) 
is known. Using (14.1) one can then calculate the output y(t) for any input u(t). 
In example 14.8, for instance, it is clear that the step response follows quite easily 
from the impulse response using (14.1). In general the convolution in (14.1) is not 
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EXAMPLE 14.9 


so easy to calculate and so the Laplace transforming method is applied for each 
input u(t) separately (as we have done in example 14.8 in order to determine the 
step response). Here the input u(t) may be any arbitrary piecewise smooth (causal) 
function, or even a distribution (being zero for t < 0). Assuming the condition of 
initial rest, we state without proof that the method outlined above always leads to the 
desired result. When the input contains the delta function 8(t), or derivatives 5® (f), 
then we should keep in mind that a number of initial conditions will be irrelevant, 
since we are then dealing with an output for which one or several of the derivatives 
has a jump at t = 0. If we want to verify afterwards that the solution y(0 we have 
found satisfies the differential equation, then we should interpret the derivatives in 
the sense of distributions. 

For the system from example 14.6 we take as input u(t) = 28(t — 1). Since (£8(t — 
l))(s) = e ~ s , it follows from (14.2) and the expression for H{s) in example 14.7 
that 

2e~ s 2e~ s 
Y{s) = 2e- s H(s)= --- 

S — 2 5—1 

Since (£e 2t )(s) = 1/(5 — 2) and CCe r )(5) = 1/(5 — 1), it follows from the shift 
property in the time domain that y(t) = 2 e(t — l)(e 2t ~ 2 — e r ~ l ). ^ 

The advantages of the Laplace transform, compared to both the classical method 
and the Fourier transform, now become clear. Towards the end of section 14.1.2 it 
was already noted that the Laplace transform immediately takes the initial condi¬ 
tions into account. Afterwards we do not have to use the initial conditions to solve 
a number of constants from a system of linear equations. A second advantage is the 
fact that the Laplace transform exists as an ordinary integral for a large class of func¬ 
tions. We only need a limited distribution theory. Finally we note that for a large 
class of inputs the Laplace transform Y ( 5 ) of the response y (f) is given by a rational 
function with real coefficients. The response y(t) can then be found by a partial 
fraction expansion followed by an inverse transform. A disadvantage of the Laplace 
transform is the fact that there is no obvious interpretation of the Laplace trans¬ 
form in terms of the spectrum of the input (also see example 14.2 and the remarks 
preceding it). 


14.1.4 Stability 

Again it will be assumed that all systems are causal LTC-systems described by a 
differential equation of the form (14.5) and with condition of initial rest (14.6). In 
section 14.1.3 it was shown that the transfer function H{s) of such a system is 
given by the rational function B{s)/A(s), where 6 ( 5 ) and A( 5 ) are the polynomials 
in (14.7). We will now show that the stability of the system (see definition 1.3) 
immediately follows from the location of the zeros of A (5). 

First note that the degree n of the numerator 6 ( 5 ) is less than or equal to the 
degree m of the denominator A (5) since n < m in (14.5). From the theory of partial 
fraction expansions (see chapter 2) it then follows that H(s) is a linear combination 
of the constant function 1 and fractions of the form 
1 

(5 — a)' 1 ’ 

where n G N and a € C is a zero of the denominator of H(s), so A (a) = 0. We re¬ 
call that the zeros of the denominator of a rational function are called the poles of the 
function (see chapter 2). Note that the constant function occurs when n = in, that 
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THEOREM 14.1 
Stability 


EXAMPLE 14.10 


is to say, when the degree of the numerator equals the degree of the denominator. 
The inverse Laplace transform of the function 1 is the delta function S(t), and the 
inverse Laplace transform of l/(s — a)" is given by the function t n ~^e at f(n — 1)! 
(see table 7), and hence we conclude that the impulse response h(t ) is a linear com¬ 
bination of the delta function <5(0 and terms of the form t n ~^e at , where n G N and 
a e C. According to theorem 10.1, the system is stable if and only if h(t) is abso¬ 
lutely integrable. Since for a causal system the function h(t) is causal, this means 
that we have to check whether / 0 | h(t) \ dt is convergent. Here we may ignore 
possible delta functions (see the remarks following the proof of theorem 10.1). Now 
take a term of the form t n ~^e at with n e N and a e C, then we thus have to check 
whether fd° t"~^e at dt is absolutely convergent. But 

roo 

/ t n - 1 e a, dt = {Ct n - 1 )(.-a), 

Jo 

and we know that the abscissa of absolute convergence of the function t "~ 1 is equal 
to 0 (see examples 12.4 and 12.5 for the case n = 2 and section 12.3.1 for the 
general case). Since the function t n ~^e at is not absolutely integrable for Recc = 0 
(for then j t n ~ i e at | = r" _l for t > 0 and f" -1 is not integrable), it thus follows 

that the function t n ~^e at is absolutely integrable precisely for Re(— a) > 0, so for 
Re <* <0. The impulse response h(t) is thus absolutely integrable when in each of 
the terms of the form r" -1 e“ r one has Re o' <0. We summarize the above in the 
following theorem. 

Let H(s) be the transfer function of a causal LTC-system described by a differential 
equation of the form (14.5) and satisfying the condition of initial rest (14.6). Then 
the system is stable if and only if the poles of H(s) lie in the half-plane Re s <0. 

Consider the system from example 14.6. From example 14.7 it follows that the 
poles of the transfer function are given by j- = 1 and s = 2. They do not lie in 
the half-plane Re s <0. Hence, according to theorem 14.1 the system is not stable. 
In example 14.7 it was shown that h(t) = e 21 — e' and indeed this function is not 
absolutely integrable (we even have h(t) —> oo if t —»■ oo). ^ 

We close this section on the application of the Laplace transform to linear systems 
with the treatment of an example which is known as the ‘harmonic oscillator’. 

14.1.5 The harmonic oscillator 

In figure 14.2 an RLC-network is drawn consisting of a series connection of a re¬ 
sistor of resistance R, an inductor of inductance L, a capacitor of capacity C and a 
voltage source generating a voltage v(t). Assume that L > 0, C > 0 and R > 0. 
As a consequence of the voltage v(t) there will be a current i(t) in the network 
after closing the switch S at time t = 0. We assume that the network is at rest at 
the moment of switching on. For such systems one can use Kirchhoff’s laws (see 
section 5.1) to obtain the following relationship between the voltage v(f) and the 
current i ( t ): 

Li'(t) + Ri(t) -1-/ i(z)dr=v(t). 

C J—oo 

Now let q(t) be the charge on the capacitor, then q(t) = i(x)dr and so i ( t ) = 
q'(t). From this we obtain for q(t) the differential equation 

Lq"(t) + Rq\t) + ^(O = v(t). 


(14.10) 
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FIGURE 14.2 
RLC-network. 


Harmonic oscillator 


Case 1 


The system described by differential equation (14.10) is known as the harmonic 
oscillator (exactly the same differential equation occurs in the study of so-called 
mass-dashpot systems; see the end of section 5.1). Since we assumed that the net¬ 
work was at rest, the condition of initial rest holds: qiO) = q'( 0) = 0. Applying the 
Laplace transform to (14.10) we obtain that 

(Ls 2 + Rs + 1/C)Q(s) = Vis), 


where Q(s) and V ( 5 ) are the Laplace transforms of q(t) and v(t) respectively. From 
this it follows in particular that the transfer function H(s) is given by H{s) = 
1 /(Ls 2 + Rs + 1/C). The denominator of H(s ) is a quadratic polynomial with 
real coefficients and discriminant R 2 — 4L/C. Let ,?i and S 2 be the roots of Ls 2 + 
Rs + 1/C, then Ls 2 + Rs + 1/C = L(s — s |) (s — S 2 ) with 




-R + ^R 2 -4L/C 
2L 


and 


*2 


-R-^R 2 -4L/C 
2L 


We assume from now on that R > 0 and determine the impulse response of the 
system in the following three cases. 

Case 1: R 2 -4L/C < 0; then 5q and S 2 are complex and 5j = S 2 - 

Case 2: R 2 — 4L/C = 0; then .sq and S 2 are real and 5q = .52- 

Case 3: R 2 - 4 L/C > 0; then .sq and 52 are real and 5q 7 ^ 52 . 

The partial fraction expansion of H(s) gives 

1 1 
5—51 5 — 52 

and by an inverse transform it then follows from table 7 that 

hit ) = — -- {e Sl ‘ - e s2? ). (14.12) 

Lis 1 - s 2 ) 

Now put 


(14.11) 


H(s) = 


1 


1 


Lis ~ 5l)(5 - 5 2 ) L(5l-5 2 ) 




and 


0 = — 


R 

2L’ 


then it follows that 51 = 52 = 0 + ici)Q, and using this we can write (14.12) as 
1 / . , . . , . \ 1 Jmt _ e-icoot 

hit ) = —— ( e ^+ ,a) o)t _ e (<r-ia>o)t) = _J_ e 0< e 
2Lcor\i V / Lcor\ 


2 i 
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Hence, 

hit ) = - e a< sincog? (14.13) 

Leo o 

with a < 0. The impulse response is a damped sinusoidal with frequency a>g. See 
figure 14.3a. This case is called a ‘damped vibration’ and is also called 'undercritical 
damping’. 

Case 2 Put a = —R/2L = sj. Since H(s) = l/(L{s — tr) 2 ) it immediately follows from 

table 7 that h(t ) = te a< /L with <r < 0. In figure 14.3b h(t ) is sketched. This case 
is called ‘critical damping’. 

Case 3 Since S\ ^ sj, the partial fraction expansion of His) is exactly the same as in 

(14.11) and so hit) is again given by (14.12). Since L > 0 and C > 0 it follows 
that R > R~ — 4L/C and so $2 < H < 0. We thus see that h(t) is the sum of 
two exponentially damped functions. Now put 



then = cr + co q and 52 = a — coo- As in case 1 we can write h(t) as 

h(t) = —e at sinhcoot = —!— e ( a +®o) f (1 - e -Z»o‘) 

Lio 0 2 Lco 0 V ) 

with a < 0. The impulse response is a damped hyperbolic sine (it is damped 
since a + coq — 5i < 0). See figure 14.3c. This case is called ‘overdamped’ or 
‘overcritical damping’. 

EXERCISES 

14.1 The impulse response h(t ) of an LTC-system is given by hit) — S(t) + te~ ! (also 
see exercise 10.7). 

a Determine the transfer function H(s) of the system. 

b Can we obtain the frequency response of the system by substituting s = ia> in 
H{s)l Justify your answer. 

c Determine the response to the input u(t) = e~ f sin t in two ways: first by apply¬ 
ing (14.1), then by determining Uis) — iCu)is) and calculating the inverse Laplace 
transform of H(s)Uis) (see (14.2)). 

14.2 For a system at rest it is known that the response to the input u{t) = t is given by 
yit) — t — cos 2 1. Determine the impulse response. 

14.3 a Verify that the function yit) = e 1 — e~ l — 21 obtained in example 14.4 is 
indeed a solution of the initial value problem given by (14.3) and (14.4). Check in 
particular that yit) satisfies the differential equation (14.3), whether we consider the 
differentiations in the ordinary sense or in the sense of distributions. 

b Verify that the impulse response hit) from example 14.7 satisfies the differential 
equation if we consider the differentiations in the sense of distributions, 
c Do the same for the response yit) front example 14.9. 

14.4 Use the Laplace transform to determine the solution of the initial value problem 
y" + 4y = 12 sin 4/ with the condition of initial rest. 
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b 




FIGURE 14.3 

The impulse response in case of undercritical damping (a), critical damping (b), and 
overcritical damping (c). 

14.5 Consider the causal LTC-system described by the differential equation y" — 5y' + 
4 y = u(t). 

a Determine the transfer function H(s) and determine whether the system is 
stable. 

b Determine the impulse response h(t). Is h(t) absolutely integrable? 
c Determine the step response a(t). 
d Determine the response to the input u(t) = e~'. 
e Determine the response to the input u(t) = 3 S(t — 1). 

14.6 We consider the harmonic oscillator with the condition of initial rest and with L > 0, 
C > 0 and R > 0. Verify for the three different cases from section 14.1.5 whether 
the system is stable or not. 

14.7 The RC-network in figure 14.4 with resistance R > 0 and capacitance C > 0 is 
considered as an LTC-system with input the voltage v(f) and output the charge q(t ) 
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14.8 


/ 



FIGURE 14.4 

RC-network from exercise 14.7. 


of the capacitor. At time t = 0, while the system is at rest, we close the switch. One 
has that Rq'{t) + C~^q(t) = v(f). Furthermore, let £ > 0 be a constant, 
a Determine the transfer function and verify whether the system is stable, 

b Determine the charge q(t) of the capacitor when v(r) = E. Also determine the 

current i ( t ). 

c Determine the response to the input v(f) = E sinaf. 

d Determine the response to the input v(t) = E8(t — 3). 

The RL-network in figure 14.5 with resistance R > 0 and inductance L > 0 is 
considered as an LTC-system with input the voltage v(t) and output the current i(t). 



FIGURE 14.5 

RL-network from exercise 14.8. 

At time t = 0, while the system is at rest, we close the switch. One has that 
Li' {t) + Ri(t) = v(f). 

a Determine the transfer function and the impulse response. Is the system stable? 
b Determine the step response. 

c Determine the response to the input v(f) = e(t — a) with a > 0. 


14.2 Linear differential equations with constant coefficients 

In section 14.1 the Laplace transform was applied to linear differential equations 
with constant coefficients and with the condition of initial rest. The method de¬ 
scribed in section 14.1.2 can also be used when arbitrary initial conditions are al¬ 
lowed. We confine ourselves in this section to the case n = 0 of (14.5) (this is not an 
essential limitation since by taking linear combinations of several functions u(t) we 
can always obtain the right-hand side of (14.5)). We will still call the functions u(t) 
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EXAMPLE 14.11 


and y(t) in (14.5) the input and the output or response respectively, and as always 
we will assume that u{t) and y (t) are causal functions. The initial conditions will be 
certain given values for y(0), y'(0 ),..., y( m_ H(0). If yW(0) 0 then this implies 
that the function yW(f) has a jump at t = 0. The condition for y®(0) should then 
be interpreted as y®(0+), and when applying the differentiation rule one should 
now use (13.10) instead of (12.10). We start with a simple example. 

Consider the differential equation y" — y = 2t with initial conditions y(0) = 0 and 
y'(0) = —2 (also see example 14.5). Apply the Laplace transform to both sides of 
the differential equation, then (13.10), applied to the function y for n = 2, implies 
that 


(s 2 T (s) — sy(0) — y'(0)^ — Y(s) 


where Y{s) is the Laplace transform of y(f). Now substitute the initial conditions 
y (0) = 0 and y'(0) = —2 and solve the equation for Y(s). We then obtain 


Y(s) = - - 2 


EXAMPLE 14.12 


W V* 2 )s 2 ~ 1 ^ 2 (i 2 -l) s 2 ' 

The inverse Laplace transform of this is given by y(t) = —21. Let us check that this 
solution satisfies all the conditions that were imposed. It is obvious that y(0) = 0. 
Interpreting y'(0) = —2 as y / (0+) = —2, we see that all the initial conditions are 
satisfied. Since for t > 0 we have y’(t) = —2 and y"(t) = 0, we also see that 
y(t) satisfies the differential equation for t > 0. Here it is essential that we do not 
differentiate in the sense of distributions at the point t = 0. For if we consider y(f) 
as a distribution, then y"{t) = —2<5 (r). This is certainly not what we want, since 
y{t) will then no longer satisfy the original differential equation, but instead it will 
satisfy y" — y = 21 — 2S(t). ^ 

From example 14.11 it is immediately clear that in general the initial condi¬ 
tions y(0), y^O), ..., y( m— 1)(0) should indeed be considered as the limiting values 
y(0+), ;/(0+), ..., y( m-1 )(0+) and that we are looking for a function y(t) satis¬ 
fying the differential equation for t > 0 and having the right limiting values. One 
should not interpret the differentiations at t = 0 in the sense of distributions. For 
then the initial conditions y(0+), y^O-F), .... y( m— H(0+) would in general have 
no meaning and the input would have to contain distributions at t = 0. 

We finally mention without proof that (13.10) can also be used to obtain the 
desired solution when the input u(t) is an arbitrary piecewise smooth function. As 
a second example we therefore choose an input which is not continuous. 

Consider the differential equation y' + 2y = 1 — e(t — 1) with initial condition 
y (0) = 2. Applying the Laplace transform and using (13.10) leads to the following 
equation for T(i): 

(sY (s) — y (0)) + 2T(i) = - — -—. 

5 s 

We then substitute the initial condition and find, after some calculations, that 

1 e~ s 2 

Y (s) - -+-. 

s(s + 2) s(s + 2) 5 + 2 

Now apply a partial fraction expansion to the first term in (14.14): 


s(s + 2) 2s 2 {s + 2) 


(14.14) 
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Since (£l)(i f ) = \/stmd(Ce 2t )(s) = l/(s + 2), it follows from the shift property 
in the time domain (theorem 12.4 or table 8) that 


£(e(f - 1)(1 - = e" 


ih)- 


2e~ 


s(s + 2) 


The inverse Laplace transform y(t) is thus given by y(t) = i — ie 2t — e{t — 1) 
— \e~ 2 ^~ i] ) + 2e~ 2 '. This can also be written as 


\ + \e 2t for 0 < t < 1, 

+ ±e~ 2 V- l > for f > 1. 


The result is shown in figure 14.6. Note that y(t) is not differentiable at t = 1 
and that at t = 0 we do not differentiate in the sense of distributions, since other¬ 
wise delta functions at t = 0 would occur and y(t) would then no longer satisfy 
the differential equation. Moreover, the initial condition would no longer make 
sense. ^ 



FIGURE 14.6 

Response to the input 1 — e(t — 1). 


EXAMPLE 14.13 


Even if the input contains distributions of the form S(t — a) or S^\t — a) with 
a > 0 (!), one can prescribe arbitrary initial conditions and still find the solution 
using (13.10). 

Consider the differential equation y" — 3y f + 2y = S (t — 2) with initial conditions 
y (0) = 0 and y'(0) = 1. When Y (s) is the Laplace transform of y (f), then it follows 
from (13.10) and table 9 that (^ 2 T(i) — 1) — 3 sY(s) + 2Y(s) = e~ 2s . Solving for 
Y (s) we obtain 


ns) = 


1 + e 2s 
j 2 — 3s + 2 


In example 14.7 we have seen that the inverse Laplace transform of l/(j 2 — 3.s + 2) 
is e 2t — e { . From the shift property in the time domain it then follows that 


C (e(t - 2)(e 2<t - 2) - e'- 2 )) (*) 


e 


-2s 


s 2 — 3s + 2 


Hence, y(t) = e 21 — e ! +e(t — 2)(e 2f_4 — e r ~ 2 ). Let us verify that y (t) satisfies all 
the conditions. Note that y(0) = 0 and that y has no jump at t = 2, which implies 
thaty'(0 = 2e 2 '—e'+e(t— 2)(2e 2r-4 — e f ~ 2 ) fort > 0 in the sense of distributions. 
We now see that y^O) = 1 and that y' has a jump at t = 2 of magnitude 1. Hence, 
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y"(t) = 4e 2t — e‘ + e(t — 2)(4e 2, ~ 4 — e r ~ 2 ) + S(t — 2) for t >0 in the sense 
of distributions. Using this it is now easy to check that y(t) satisfies the differential 
equation, provided that we differentiate in the sense of distributions for t > 0. Note 
that again we do not differentiate in the sense of distributions at / = 0. ^ 

If we do not have the condition of initial rest, then we will not allow delta func¬ 
tions <5(0 and/or derivatives of <5(0 in the input u(t). For then it is no longer clear 
whether or not we should differentiate the solution y(t) in the sense of distributions 
at t = 0. One can resolve this issue by dropping the causality of y{t). We will not 
go into this any further, since situations like these will not be considered in this book 
(but see exercise 14.15). 

In summary one can use (13.10) to solve linear differential equations with con¬ 
stant coefficients and arbitrary initial conditions y(0) = y(0+), y^O) = ;/(0+), 
..., y( m- l)(0) = y( m_1 )(0+) whenever the (causal) input u(t) consists of a piece- 
wise smooth function and/or delta functions S(t — a) or <5®(f — a) with a > 0. 
The solutions then satisfy the differential equation for t > 0 if we differentiate in 
the sense of distributions. At t = 0 we should not differentiate in the sense of 
distributions. 


14.9 

14.10 

14.11 

14.12 

14.13 

14.14 

14.15 


EXERCISES 

a Verify that the solution y(t) from example 14.12 satisfies the differential equa¬ 
tion y' + 2y = 2<5(/) + 1 — e(t — 1) (instead of the original differential equation 
y' + 2y = 1 — e(f — 1)) if we differentiate in the sense of distributions at t — 0. 
b Give the differential equation that is satisfied by the solution _>>(/) from example 
14.13 if we differentiate in the sense of distributions at t = 0. 


Use the Laplace transform to solve the following initial value problem: 
y" + y = t with y(0) = 0 and y'(0) — 1. 

Use the Laplace transform to solve the following initial value problem: 
y" + 4y = 0 with y(0) = 1 and /(0) = 2. 

Use the Laplace transform to solve the following initial value problem: 
y" _ 4 V ' _ 5 y — 3 e ’ with y(0) = 3 and y'(0) = 1. 

Use the Laplace transform to solve the following initial value problem: 
y" + y = u(t) with v(0) = 1 and y/(0) = 0 and 


u(t) 


! for 0 < t < 2 , 

2 for t >2. 


Use the Laplace transform to solve the following initial value problem: 
y" + 2 y’ + 5y = 28 (t - 2) + 1 with y(0) = 2 and /(0) = -2. 

In this exercise we show for a simple differential equation which kinds of phenom¬ 
ena may occur if we take <5(r) as input without having the condition of initial rest. 
Consider the initial value problem y" — y = <5(f) with y (0) = 1 and y r (0) = 0. 
a Show that the well-known solution method using the Laplace transform leads to 
the function y(t) = cosh / + sinh/. 

b Verify that y (/) from part a does not satisfy the original differential equation, 
but instead satisfies the differential equation y" — y = 0 if we do not differentiate 
in the sense of distributions at / = 0. 

c Verify that y (/) from part a does not satisfy the original differential equation, but 
instead satisfies the differential equation y" — y = Sit) + 8'(t) if we do differentiate 
in the sense of distributions at / = 0. 
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d Consider the function y(t) = coshr + e(t) sinhf on R (so this is not a causal 
function!). Show that this function does satisfy the original initial value problem, if 
indeed we consider v'(0) as y'(0—) (and hence not as v' (0+)). 


14.3 Systems of linear differential equations with constant coefficients 


Using the Laplace transform one can also solve systems of several coupled ordinary 
linear differential equations with constant coefficients. We confine ourselves here 
to systems of two such coupled differential equations, since these can still be solved 
relatively easy without using techniques from matrix theory. Systems of more than 
two coupled differential equations will not be considered in this book. We merely 
note that they can be solved entirely analogously, although matrix theory becomes 
indispensable. 

In general, a system of two coupled ordinary linear differential equations with 
constant coefficients and of first order has the following form: 

1 flux' + a 12 y' + b\\x + b\ 2 y = u\(t ), 

« 21 *' + any' + b 2\x + b 2 2y = u 2 (t ), 

with initial conditions certain given values for x(0) and y(0). Similarly, one can 
describe the general system of second order with initial conditions x(0), x'(0), y(0) 
and y'(0) (for higher order and/or more differential equations the vector and ma¬ 
trix notation is much more convenient). The solution method based on the Laplace 
transform again consists of Laplace transforming all the functions that occur, and 
then solving the resulting system of linear equations with polynomials in s as co¬ 
efficients. As far as the initial conditions are concerned, the same phenomena may 
occur as in sections 14.1 and 14.2. We will not go into this any further and confine 
ourselves to two simple examples. Lor a more extensive treatment of this subject we 
refer to the literature (see for example Guide to the applications of Laplace trans¬ 
forms by G. Doetsch, sections 15-19). 

Consider the system 

I lx' + y' + 2x = 0, 

{ x' + 3y'Ty = 0, 

with initial conditions x(0) = 1 and y(0) = 0. Let X(s) and F(s) be the Laplace 
transforms of x(t) and y(t). According to (13.10) one then has 

C(7x' + / + 2x)(s ) = 7(sX - x(0)) + (sF - y(0)) + 2X, 


and by substituting the initial conditions one obtains that 7(sX — 1) + sF + 2X — 0, 
or (7s + 2)X + sY = 7. Transforming the second differential equation of the 
system in a similar way, we see that the Laplace transform turns the system into the 
algebraic system 

[ (7s + 2)X + sY = 1, 

I sX + (3s + 1)F = 1. 


Solving this system of two linear equations in the unknowns X = X(s) and Y — 
Y (s), we find that 


= 7(3, + !)-, 

(3s + l)(7s + 2)-s 2 


Y(s ) 


7s - (7s + 2) 
s 2 - (7s + 2) (3s + 1) 


20.s + 7 

(4.s + 1)(5 j’ + 2) ’ 
2 

(4.s- + 1X5.5 + 2) 
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EXAMPLE 14.15 


(X ( 5 ) is found by multiplying the first and the second equation by, respectively, 3s + 
1 and s and subtracting; Y(s ) follows similarly). Using partial fraction expansions 
we obtain that 

2 , 1 
3(5 + 1/4) + SlTTW 
2 2 
3(s + 1/4) ~~ 30 + 2/5) ’ 
see that the solution to the system is given by 

J X (t) = §e-'/ 4 +±e- 2f / 5 , 
l y (0 =2 e -,/4_2 e -2„5. 

It is easy to verify that x(t) and y(t) satisfy the system of differential equations 
for t > 0 and that x(0+) = 1 and y(0+) = 0 (note that at t = 0 we should not 
differentiate in the sense of distributions). ^ 

Systems of coupled differential equations occur, for example, in RCL-networks 
having more than one closed loop. This is because, according to Kirchhoff’s laws, 
there is then a differential equation for every closed loop. We close this section with 
an example of such a situation. 

Consider the RL-network from figure 14.7. At the node K, the current i splits into 
two currents i\ and 0- In the closed loop containing R and L we have Ri + Li j = 


X(i) = 


= 


3(45 + 1) 


+ 


3(55 + 2) 
10 


3(45 + 1) 3(55 + 2) 

and by inverse transforming this we 



FIGURE 14.7 

RL-network described by a system of two differential equations. 

v(t), while in the closed loop containing the two resistors R we have Ri + Ri 2 = 
v(t). We want to determine the step response, that is, v(f) = e(0, with the system 
being at initial rest. Since i = i\ + iy, hence Rin = Ri — Ri 1 , we have to solve the 
following system in the unknown functions i(t) and i\(t)\ 

I Ri + Li'y = 6(f), 

[ 2 Ri — Ri] = e(0, 

with initial conditions i (0) = i\ (0) = 0. Laplace transforming leads to 

RI + sLli = l/s, 

2RI - RIi = 1/5, 

where I = Li and I\ = Ci\. It is not hard to solve this for I (multiply the first 
equation by R, the second by sL, and add) and then to apply a partial fraction 
expansion: 

1 R + sL 1/1 1 

J ~ Rs(R + 2sL) ~ ~R ~ 2(5 + R/2L) 
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14.16 


14.17 


14.18 


14.19 


After inverse transforming this we see that the step response is given by the function 
a(t) = (2 - e- R, / 1L )/2R. M 

EXERCISES 

Use the Laplace transform to solve the following system with initial conditions 
x(0) = — 1 and v(0) = 0: 

| x' + v = 2 cos It, 
y y' + x = sin 2 1. 

Use the Laplace transform to solve the following system with initial conditions 
x(0) = 0, x'(0) = 2, y(0) = -1 and y'( 0) = 0: 

| x" + y' = 0, 

| y" — x' = 0. 

Use the Laplace transform to solve the following system with initial conditions 
x(0) = 1 and y(0) = -1: 

f 2y' + y 4- 5x' — 2x = 2e ~ f , 

( — y' — 2x' + x = sin t. 

Consider the RCL-network from figure 14.8 with resistors R, inductor L and capac¬ 
itor C. At time t = 0 we close the switch S while the network is at rest. In the 



FIGURE 14.8 

RCL-network from exercise 14.19. 

closed loop containing the two resistors one has Ri + Li ^ + Ri i = u{t) and since 
i = i\ +J 2 it follows that Rix + Li'^ -\-2Ri\ = ii(t). In the closed loop containing the 
capacitor and the inductor one has C -1 i 2 ( T ) dx — Ri\ — Li j = 0. We now 

take R = 1 ohm, L = 1 henry, C = 1 farad and «(r) = 1. 
a Use the Laplace transform to solve the resulting system 

I z '2 + 2i\ + (j = 1, 

l /—oo *2( T ) dt — i\ ~ i\ =0 

in the unknown functions i\ and ii (the initial conditions are z'i(O) = /A (0) — 0). 
(Hint: since i 2(0) = 0, the function z '2 will be continuous on R and so the integration 
rule in the time domain can be applied.) 

b Calculate the voltage drop y(t) = f_ iiir) dx across the capacitor. Now note 
that here we are studying the same network as in exercise 10.22 and so compare the 
answer with the step response found in exercise 10.22a. 
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Initial condition 
Boundary condition 


EXAMPLE 14.16 
Half-infinite string 


14.4 Partial differential equations 


Up till now we have only studied ordinary differential equations in this chapter: the 
unknown functions depended only on one variable, which was mostly associated 
with time. In partial differential equations the unknown function depends on several 
variables. As in chapters 5 and 10. we only consider partial differential equations 
for functions u(x , t) of two variables. Just as in chapter 5, we will denote the partial 
derivatives of the function u(x, t) with respect to x and t by u x , u t , u xx , etc. The 
f-variable will again be interpreted as time, while the v-variable will be associated 
with position. The switch-on moment is chosen as being t = 0 in the time domain, 
and the conditions at t = 0 (for example u(x, 0) or u r (x,0)) will be called the 
initial conditions. Conditions in the position domain x (such as zz(0, t) or i/ v (0, t)) 
will be called boundary conditions (although sometimes this term is also used for all 
conditions taken together). In sections 5.2 and 10.4 we have seen how the Fourier 
transform can be used to solve partial differential equations. In this section we 
will show how this can be done using the Laplace transform. Again, the method 
is essentially the same as in the previous sections, having the same advantages. 
However, in partial differential equations we are dealing with functions depending 
on two variables. Since the Laplace transform can only be applied to one variable, 
we will have to make a choice. In most cases one chooses a transform with respect 
to the f-variable. From the function u{x, t ) one then obtains for each x a Laplace 
transform depending on 5. This will be denoted by U(x, s), so 

rOO 

(£u(x, t))(s) = I u(x,t)e~ st dt = U(x, s). (14.15) 

JO 

Similarly, we have initial conditions for each.r, like u{x, 0) or u r (x,0), which again 
should be interpreted as limiting values u(x, 0+) or ui(x, 0+) if necessary. All pre¬ 
vious results, in particular the differentiation rules in the time domain from (12.10) 
and (13.10), can now be applied in the f-variable for fixed x. Concerning the differ¬ 
entiations in the x-variable, we will assume that differentiation and Laplace trans¬ 
form may be interchanged, for example: 

roo Q u g / roo \ 

(Cu x {x,t)){s) — / —( x,t)e~ st dt= — ( / u(x, t)e~ sr dt ) 

Jo dx dx \J o ) 

= ^-{Cu(x, t)){s) = U x (x, s). 
ox 

We will now show how the Laplace transform can be used to solve partial differential 
equations with initial and boundary conditions. 

Consider a half-infinite string being at rest at time f = 0 along the positive .v-axis. 
We let the string vibrate by moving the left end at x = 0 once up and down in the 
following way: 


«(0, f) = /(f) = 


sinf for 0 < f < 2n, 
0 elsewhere. 


Of course, an infinitely long string does not exist in reality, but we use it as a math¬ 
ematical model for a long string or a long piece of rope. From experience we know 
that if we move a piece of rope once up and down, a travelling wave in the rope 
will arise. See figure 14.9. It is known that the equation of motion of the string is 
given by 

lift = c u xx 


for x > 0 and f > 0, 


(14.16) 
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1 



u(0, f) 


0 


x 


-1 


FIGURE 14.9 

Travelling wave in a half-infinite string. 

where c > 0 is a physical constant. Because of the state of rest at t = 0, we have the 
initial conditions u(x, 0) = 0 and utix, 0) =0 for x > 0. The second initial condi¬ 
tion indicates that the initial velocity of the string at t = 0 is zero. Since the string 
has infinite length in the positive x -direction, we have lim.y-^oo u(x. t) = 0 for 
t > 0 (such a condition will be called a boundary condition as well). Summarizing, 
the initial and boundary conditions are given by 

u(x, 0) = iit(x, 0) = 0 for jc > 0, 
lim^-^oo u(x,t) = 0 for t > 0, 
u( 0, t) = f(t) for t > 0. 

We now assume that the Laplace transform U(x, s) of u(x, t ) exists and that all the 
operations we will be performing are allowed. Once a solution u(x,t) has been 
found, it has to be verified afterwards that it indeed satisfies the partial differential 
equation and all the initial and boundary conditions. We will not go into this any 
further and omit this verification. 

If we apply the Laplace transform with respect to t to the partial differential 
equation (14.16), then it follows from (13.10) that 

s 2 U(x, s) — su(x , 0) — u,(x, 0) = c 2 {Cu xx )(s). 

Since we assumed that differentiations with respect to x and the Laplace transform 
may be interchanged, it follows that (Cu xx )(s) = U xx (x, 5). Substituting the initial 
conditions u(x, 0) = u t (x,0) = 0, we obtain that s 2 U(x, s) = c 2 U xx (x, s), or 
U xx — ( s 2 /c 2 )U = 0. We have thus transformed the partial differential equation for 
u(x, t) into the ordinary differential equation 



(14.17) 


c 


for U(x, s) as function of x (s being constant), which is a considerable simplifica¬ 
tion. The general solution of differential equation (14.17) is 


U(x,s) = Ae sx ' c + Be~ sx ' c 


where A and B can still be functions of s. To determine A and B, we translate the 
remaining boundary conditions to the 5-domain by Laplace transforming them. 
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Step 1 


Step 2 


Step 3 


14.20 


From the condition lim^-^oo u(x, t) = 0 it follows that 

poo poo 

lim U(x,s) = lim / ufx,t)e~ st dt = / 

*—►00 *^°° J o J o 

where we assume that the limit and the integral may be interchanged. Since U (x, s) 
exists in a certain half-plane, it will in particular be defined for values of j e C with 
Res > 0, and so having Re s/c > 0 as well (because c > 0). Using this we see that 
lim.v-^oo e sx ' c does not exist and so A = 0. 

If we now apply the Laplace transform to the remaining boundary condition 
u( 0, t ) = /(f), then it follows that B = U( 0, s) = F(s) with F(s) = (jC.f )(s). 
Hence, the solution in the s -domain is now completely determined: 

Ufx,s) = F(s)e~ sx/C . 


lim ufx,t))e st dt = 0, 
jc —>oo / 


The shift property in the time domain (table 8) finally gives us the function ufx, t) = 
eft — x/c)f(t — x/c) as the inverse Laplace transform. With our choice for the 
function / this means that the solution is given by 

I sin(f — x/c) for x/c < t < x/c + 2n, 
ux,t | o elsewhere. 

This is a sinusoidal wave, travelling to the right with speed c. A point x remains at 
rest until t = x/c, the time necessary to reach this position. The motion of the point 
x is then identical to the motion of the left end x = 0. ^ 


In summary, the most important steps in solving partial differential equations 
using the Laplace transform are as follows: 

Each term of the partial differential equation for ufx, t) is Laplace transformed with 
respect to one of the variables, mostly the time variable t. For the Laplace trans¬ 
form U (x, s) we obtain an ordinary differential equation, since only derivatives of 
U (x, s) with respect to x occur in the transformed equation. Moreover, this equation 
contains all the initial conditions. 


The ordinaiy differential equation is solved using all known means. To do so, we 
must also determine the boundary conditions for U (x, s). These can be found by 
transforming the boundaiy conditions for u(x, t). 

The solution obtained in the j-domain is transformed back into the /-domain. For the 
solution ufx, t) thus found, one can verify whether it satisfies the partial differential 
equation and all the conditions. 


EXERCISES 

A string attached at ,y = 0 and x = 1 is given the initial position u (x, 0) = 2 sin 2nx 
at time t = 0 and is then released. Let ufx, t) be the position of the string at point x 
and time t. The equation of motion of the string is given by utt = 4 u xx (0 < x < 1, 
t > 0). The initial and boundary conditions are given by 

I «(0, t) = «(1, t) = 0 for t > 0, 
iit(x, 0) = 0 for 0 < x < 1, 

ufx, 0) = 2sin2jr.r for 0 < x < 1. 

Solve this problem using the Laplace transform. 

An insulated rod is fixed at x = 0 and x = n and has initial temperature ufx, 0) = 
4 sin x. Let u(x, t) be the temperature at position x and time t. The ends of the rod 
are cooled and kept at a temperature of 0 degrees, so u( 0, /) = 0 and ufj r, t) = 0. 
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14.22 


The temperature distribution is described by the heat equation u t = u xx (0 < x < 
n,t> 0). Find the temperature distribution u{x, t) using the Laplace transform (in 
the calculations for this exercise you may use the complex function ffs in a formal 
way; this function has not been treated in chapter 11 since the ‘multivaluedness’ 
problem arises here: for one value of $ there are two values we C with w = .yA). 

Consider for u(x, t) the partial differential equation u t = u xx — 6u (0 < x < n, 
t > 0) with initial condition u(x, 0) = cos(jr/2) (0 < x < n) and boundary 
conditions u{n, t) = 0 (f > 0) and u x ( 0, /) = 0 (t > 0). Solve this problem using 
the Laplace transform. 


SUMMARY 


The Laplace transform is very well suited for the study of causal LTC-systems for 
which switch-on phenomena occur. If hit) is the impulse response of such a sys¬ 
tem, then the transfer function or system function is given by the Laplace transform 
H{s) of h(t). If u(t) is an input with {Cu)(s) = U(s) and y(t) the response with 
iCy)(s) = Y(s), then Y(s) = H(s)U(s). 

An important class of causal LTC-systems is described by an ordinary linear dif¬ 
ferential equation with constant coefficients (in the form of (14.5)) and with the 
condition of initial rest (as in (14.6)). In this case the system function is given by 
the rational function 


b n s n + • • • + b\s + by 

H(s ) = -, 

a m s m + ■ ■ ■ + a\s + «o 

where n < m. After a partial fraction expansion, one can obtain the impulse re¬ 
sponse h{t) from this by an inverse transform. The response y(t) to an arbitrary 
input is then given by y(t) = (h * u)(t). Calculating this convolution is in general 
not very easy. Instead, one can also immediately apply the Laplace transform for a 
given input u(t). The differential equation, including the initial conditions, is then 
transformed into an algebraic equation for Y fy). This equation is easy to solve and 
for a large class of inputs, Y (s) is again a rational function of .s' with real coefficients. 
Using a partial fraction expansion and an inverse transform, one then obtains y(t). 

The stability of the system follows from the location of the poles of H(s): these 
should lie in the half-plane Re s < 0. 

In exactly the same way one can apply the Laplace transform to ordinary linear 
differential equations with constant coefficients and having arbitrary initial condi¬ 
tions. The input may be any combination of piecewise smooth functions and distri¬ 
butions 5(f — a) or S^ k \t — a) with a > 0. The obtained solution should not be 
differentiated in the sense of distributions at t = 0. 

We can also apply the Laplace transform to a system of coupled ordinary linear 
differential equations with constant coefficients. Transforming it will turn it into a 
system of linear equations having polynomials in s as coefficients. From this, the 
unknowns in the .v-domain can be solved. An inverse transform then leads to the 
solution of the system of differential equations. 

Finally, the Laplace transform can also be used to solve certain partial differential 
equations with initial and boundary conditions. Transforming this will lead to an 
ordinary differential equation containing the initial conditions. By also transforming 
the remaining boundary conditions, one can solve the ordinary differential equation. 
The solution in the s-domain thus obtained can be transformed back to the t-domain. 
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SELFTEST 


14.23 


14.24 


14.25 


14.26 


For an LTC-system it is known that the step response a{t) is given by a{t) = 
cosh 2t — 2 cos t + e~ l . 

a Determine the impulse response and the transfer function, 
b Determine the response to the input u(t) = 28 (t — 1). 
c Determine the response to the input u(t) = t. 

Consider the harmonic oscillator with the condition of initial rest and with L > 0, 
C > 0 but R = 0. We are then dealing with an LC-network as in figure 14.10. 
At t = 0 we close the switch S. The network is considered as an LTC-system with 


i L 



FIGURE 14.10 

LC-network from exercise 14.24. 


input the voltage v(f) and output the charge q(t) of the capacitor. One has that 
Lq"(t) + C~ l q{t) = v(f) with q(0) = q'( 0) = 0. 
a Determine the transfer function and the impulse response, 
b Is the system stable or not? Justify your answer, 
c Determine the charge q{t) of the capacitor if v(r) = e~ at with a > 0. 
d Determine the response q(t) to v(t) = cos at with a f (LC)~ l// ~. 
e Put tup = (LC) -1 / 2 . Determine the response q(t) to v(t) = 2cosa>Qt. Verify 
that linv-j .00 | q(t) \ = oo and sketch q(t). 


Use the Laplace transform to solve the following initial value problem: 
y" + y’ — 2y = u(t ) with y(0) = 1 and yfO) = 1 and with u(t) given by: 
cos t for 0 < t < n, 

0 for t > n. 


u(t) = 


b w(f) = 3«(f - 2) + 6S'(f - 3). 


Consider the RL-network from figure 14.11 with the three resistors R, 2R and 2 R, 
the inductors L and 2 L, and the voltage source v(f). At time t = 0 we close the 
switch S, while the network is at rest, soi(0) = ;'i(0) = 72(0) = 0. By considering 
the closed loops ABEF and BCDE, one obtains the following system of differential 
equations in the unknown functions and i 2 (use that i = i\ + 12 ): 


| 2Ri 2 + 3Ri\ + Li j = v(t), 
j 2 Li' 2 + 2Ri 2 - Ri 1 - Li\ = 0. 

Use the Laplace transform to determine the currents i(t), i\ (t) and i 2 (t) when the 
voltage v(t) is given by: 
a v(f) = E, with E a constant, 
b v(f) = sin2f. 
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A / B C 



FIGURE 14.11 

RL-network from exercise 14.26. 


A string at rest is attached at x = 0 and x = 2. Let u(x, t) be the position of 
the string at point x and at time t. At t = 0 the string is given an initial velocity 
ut(x , 0) = 2sin7rjr. The equation of motion of the string is given by utt = 4 u xx 
(0 < x < 2, t > 0). The initial and boundary conditions are given by 

I m(0, t) = u(2, t) = 0 for t > 0, 
u(x, 0) = 0 for 0 < x < 2, 

ut(x, 0) = 2sin7rjc for 0 < x < 2. 

Solve this problem using the Laplace transform. 
















Part 5 

Discrete transforms 


INTRODUCTION TO PART 5 


In the previous chapters we have seen how the Fourier transform of a continuous¬ 
time signal can be calculated using tables and properties. However, it is not al¬ 
ways possible to apply these methods. The reason could be that we only know the 
continuous-time signal for a limited number of moments in time, or simply that 
the Fourier integral cannot be determined analytically. Starting from a limited set 
of data, one then usually has to rely on numerical methods in order to determine 
Fourier transforms or spectra. To turn a numerical method into a manageable tool 
for a user, it is first transformed into an algorithm, which can then be processed by a 
digital computer. The user then has a program at his/her disposal to calculate spectra 
or Fourier transforms. Calculating the spectrum of a continuous-time signal using a 
computer program can be considered as signal processing. When an algorithm for 
such a program is studied in more detail, then one notices that almost all calcula¬ 
tions are implemented in terms of numbers, or sequences of numbers. In fact, the 
continuous-time signal is first transformed into a sequence of numbers (we will call 
this a discrete-time signal ) representing the function values, and subsequently this 
sequence is processed by the algorithm. One then calls this digital signal process¬ 
ing. It is clear that because of the finite computing time available, and the limited 
memory capacity of a digital computer, the spectrum can only be determined for a 
finite number of frequencies, and is seldom exact. Moreover, when transforming 
the continuous-time signal into a discrete-time signal, there will in general be loss 
of information. However, because of the rapid development of the digital computer, 
especially the capacity of memory chips and the processor speed, capabilities have 
increased enormously and disadvantages have diminished. This is one of the rea¬ 
sons why the field of digital signal processing has aroused increasing interest (as is 
witnessed by the growing literature, e.g. Digitale signaalbewerking by A.W.M. van 
den Enden and N.A.M. Verhoeckx (in Dutch)). 

Applications of digital signal processing can nowadays be found in several fields. 
For the consumer we have, for example, the compact disc and high definition tv. 
In industry digital computers are used to control industrial processess (robotics), 
photos originating from satellites are being analysed using so-called digital imaging 
techniques. In the medical sciences, digital processing is used in cardiology, for 
instance. 

An important subject in the field of digital signal processing is the discrete trans¬ 
form of signals, that is, transforms defined for discrete-time signals. They have 
many similarities with the Fourier and Laplace transforms of continuous-time sig¬ 
nals, treated in the previous parts. 

Chapter 15, the first chapter of this part, focusses mainly on the problem of the 
transformation of a continuous-time signal into a discrete-time signal. One would 
like to minimize the loss of information which is always introduced by this transfor¬ 
mation in various kinds of applications. 
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In chapter 16 the so-called discrete Fourier transform is treated. This transform 
is often used when analysing spectra of signals. The fast algorithms to calculate 
the discrete Fourier transform are collectively known as the Fast Fourier Transform, 
FFT for short. In chapter 17 we treat a frequently used example of an FFT algorithm. 

The so-called z-transform, the subject of chapter 18, is a valuable tool used to de¬ 
scribe discrete-time systems. For example, the frequency response of a discrete-time 
system (see chapter 1) can easily be obtained from the z-transform of the impulse 
response. 

Finally, chapter 19 treats in particular the applications of discrete-time transforms 
to discrete-time systems. In chapter 1 these discrete-time systems have already been 
discussed in general terms. As such, one can consider chapter 19 as the closing 
chapter of this final part on discrete transforms. 
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CHAPTER 15 


Sampling of continuous-time signals 


INTRODUCTION 


In chapter 1 signals were divided into continuous-time and discrete-time signals. 
Ever since, we have almost exclusively discussed continuous-time signals. This 
chapter, being the first chapter of part 5, can be considered as sort of a transition from 
the continuous-time to the discrete-time signals. In section 15.1 we first introduce 
a number of important discrete-time signals, which are very similar to well-known 
continuous-time signals like the unit pulse or delta function. Subsequently, we pay 
special attention in section 15.2 to the transformation of a continuous-time signal 
into a discrete-time signal (sampling) and vice versa (reconstruction), leading to 
the formulation and the proof of the so-called sampling theorem in section 15.3. 
The sampling theorem gives a lower bound (the so-called Nyquist frequency) for the 
sampling frequency such that a given continuous-time signal can be transformed into 
a discrete-time signal without loss of information. We close with the treatment of the 
so-called aliasing problem in section 15.4. This problem arises when a continuous¬ 
time signal is transformed into a discrete-time signal using a sampling frequency 
which is too low. 

LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- can describe discrete-time signals using unit pulses 

- can describe periodic discrete-time signals using periodic unit pulses 

- can explain the meaning of the terms sampling, sampling period and sampling 
frequency 

- can explain the sampling theorem and can apply it 

- can understand the reconstruction formula for band-limited signals 

- can describe the consequences of the aliasing problem. 


15.1 Discrete-time signals and sampling 

In chapter 1 a discrete-time signal was defined as a complex-valued function having 
as domain the set Z of integers (see section 1.2.1). To make a clear distinction with 
continuous-time signals, we will denote discrete-time signals with square brackets 
enclosing the argument, so /[«], g[«], etc. By the way, the term discrete-ft'me in 
signal theory is somewhat misleading. It suggests, as for continuous-time signals, 
that this refers to time as being the independent variable. This is not necessarily 
always the case. 

In practice the signals will only be given on a limited part of Z. In fact, the signal 
then consists of a finite sequence of numbers. The domain can then be extended to 
all integers by adding zeros to the sequence or by extending it periodically. 
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EXAMPLE 15.1 


EXAMPLE 15.2 


Sampling 
Sampling period 
Samples 

Sampling frequency 


EXAMPLE 15.3 


DEFINITION 15.1 
Discrete unit pulse 


THEOREM 15.1 


We will often omit the adjective 'discrete-time’ whenever it is clear from the 
context that we are dealing with discrete-time signals. 

For a given periodic continuous-time signal with period T and line spectrum c n we 
can define a discrete-time signal by 

f[n] = c n for n e Z. 

Here it is clear that the term discrete-time is misleading. Rather one should call this 
a discrete-frequency signal. ^ 

For a given continuous-time signal f(t) and a positive number T we define a 
discrete-time signal by 

/[/;] = f(nT ) forn e Z. 

◄ 

The signal f\n\ from example 15.2 is called a sampling of the signal f(t) at 
the points 0, ±T, ±27\ .... The positive number T is called the sampling period, 
l/T the sampling frequency, and the values f(nT ) the samples of the sampling. 
In this book, however, we mainly use angular frequencies and so here the sampling 
frequency a> s is defined as 

2 n 

co, = —. (15.1) 


Sampling of the signal f(t) = sinfcooD, where cog is a given positive frequency, 
with the following sampling frequencies leads to the corresponding discrete-time 
signals: 


frequency 

CDs = co o 
a> s = 8a>g 
co s — ncog 


signal 

f[n] = sin(2:rrn) = 0 
f\n\ = sin(/ur/4) 
f[n] = sin(2n). 


Note that sampling with a > s = 8cno results in a periodic discrete-time signal f[n] = 
f(nn/Acog) having period N = 8 (see figure 15.1). For co s — ncog however, we see 
that despite the periodicity of f(t), the sampling is no longer periodic. ^ 

An elementary signal is the so-called discrete unit pulse <5[n], also called the 
Kronecker delta function, which is defined as follows. 


The discrete unit pulse <5[/i] is defined by 


m = 


1 for n = 0, 
0 for n 0. 


The discrete unit pulse has a nice and simple property, which is formulated in our 
following theorem. 


For an arbitrary discrete-time signal f[n] one has 


oo 


/[/;] = f[k]&[n — k ] for n e Z. 

k=—oo 


(15.2) 


Proof 

Note that in the infinite sum in the right-hand side all terms are zero, except for the 
term with k = n. The latter equals f[n\. The sum is thus equal to f[n ] as well, g 



342 


15 Sampling of continuous-time signals 


EXAMPLE 15.4 



FIGURE 15.1 

Sampling of sin(a>oO with frequency 8&>o. 


Put into words, the theorem above states that an arbitrary discrete-time signal can 
be written as a superposition of shifted unit pulses. 

The signal /[n] defined by 

for n = 0, 
for n = 1, 
for n = — 1, 
elsewhere, 

can also be written as follows: 

f[n ] = 25 [n + 1] + 5[n] - S[n - 1], 

In figure 15.2 this signal f[n\ is represented by a graph. ^ 


/[«] = 


1 

-1 

2 

0 


-- 2 


fin] 


-4-4- 

-3 -2 


-1 
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0 


4-4 
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- 1 - 


► 


n 


FIGURE 15.2 

The signal f\n] — 28[n + 1] + 5[u] — 5[n — 1]. 

Besides in the form of formula (15.2), a periodic discrete-time signal /[«] with 
period N, that is, f\n + A] = /[«] for all n e Z (see section 1.2.2), can also be 
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written in another way as a superposition. To this end we first introduce the so-called 
periodic train of discrete unit pulses. 

DEFINITION 15.2 Let N be a positive integer. The periodic train of discrete unit pulses <5jy[n] with 

Periodic train of discrete unit period N is given by 

pulses 

I 1 if n is an integer multiple of N , 

5 ' v(,7|= | 0 otherwise. 

In figure 15.3 a graph of <$ 3 [//] is drawn. It is easy to express an arbitrary periodic 
signal with period N as shifted trains of discrete unit pulses. 


S 3 [n] 

• - 

► 

n 

FIGURE 15.3 

Periodic train of discrete unit pulses. 


♦ -- * - « - * - * - * 
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THEOREM 15.2 


Let f[n\ be a periodic discrete-time signal with period N. Then 


N -1 

f[n] = ^ f[k]S/y[n — k] forn e Z. 
k=0 


Proof 

In the right-hand side of the sum above, each of the terms represents a periodic 
signal with period N. It is then easy to see that the sum itself also represents a 
periodic signal with period N. We thus only need to prove the equality for the 
values n = 0, 1, 2,..., N — 1. But this follows immediately from the definition of 
cSjvM- ■ 


EXAMPLE 15.5 


DEFINITION 15.3 

Discrete unit step function 


The signal f[n] given by 

/[0]= l,/[l]=0,/[2]=-l,/[3] = 0, 

and furthermore periodic with period 4, can also be written as 

f[n] = A 4 [/ 7 ] — Sql [n — 2 ], 

◄ 

We close this section with the introduction of the discrete version of the unit step 
function e(t). 

The discrete unit step function s[n] is defined by 


e [n] = 


1 forn > 0 , 
0 forn < 0 . 


The graph of e[n\ is drawn in figure 15.4. The signal e[n] is thus an example of 
a causal signal. If f[n\ is an arbitrary discrete-time signal, then the signal /[n]e[n] 
is a causal signal coinciding with the signal f\n] for n > 0 . 
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Reconstruction 
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FIGURE 15.4 

The discrete unit step function. 


EXERCISES 

15.1 A discrete-time signal is given by f[n] = e[n — 4] — e[n + 1], Describe the signal 
as a superposition of discrete unit pulses. 

15.2 A periodic discrete-time signal with period 5 is given by /[—2] = 1, /[—1] = 0, 
/[0] = 1, /[l] = 0, /[2] = 1. Describe the signal as a superposition of periodic 
trains of unit pulses. 

15.3 Let the complex number z = \ (-n/ 3 + t) be given. Consider the discrete-time signal 
/[ n] — z n ■ Show that /[/?] is periodic. 

oo 

15.4 Show that e[n] = <5[n — k], 

k=0 

15.5 Sketch the graph of the signal f\n\ = 2^4[n — 1] + e[n + 1], 


15.2 Reconstruction of continuous-time signals 

Sampling turns a continuous-time signal into a discrete-time signal. Of course it 
is clear that this may result in loss of information. The loss will be reduced to 
zero if, for a given sampling, we are able to get a complete reconstruction of the 
continuous-time signal. Hence, the discrete signal must be converted back into a 
continuous-time signal. This process is called reconstruction. Several reconstruc¬ 
tion methods exist. A simple method, based on linear interpolation, will be treated 
in this section. However, it will turn out that this method has some disadvantages. 
In section 15.3 we will treat a better method which, under certain conditions, will 
recover the original continuous-time signal. 

In a linear interpolation one constructs from a given sampling f[n] = f(nT) a 
continuous-time signal f T (t) having the following properties (see figure 15.5): 



FIGURE 15.5 
Linear interpolation. 
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Linear interpolation 



FIGURE 15.6 

Reconstruction of sin(a>oO after sampling, 
a f(rtT) = f\n] for all integer n; 

b between the two consecutive points nT and (n + 1)2™ the graph of f T (t) consists 
of a straight line. 

We now say that for t e (nT, (n + 1)T) the values / r (f) are obtained from the 
values f[n] and f\n + 1] by linear interpolation. Reconstruction of the periodic 
signal sinfcupf) for sampling frequency a> s = 8ft>o leads to the signal consisting of 
the line elements as drawn in figure 15.6. A signal f r (t) obtained by linear interpo¬ 
lation from a sampling /[»] can be written in a very nice way as a superposition of 
triangular pulses. To this end we will use the triangular pulse function qp(t) (see 
(6.12), where we called it the triangle function). This signal also arises as the recon¬ 
struction by linear interpolation of the discrete unit pulse 5[n] with sampling period 
T. The shifted signal qj(t — kT ) can be considered as a reconstruction of c5[n — k ] 
(see figure 15.7). Since according to theorem 15.1 we have 

oo 

/[«]= I] f[k]8[n-k], 
k=—oo 



FIGURE 15.7 

The triangular pulse function as linear interpolation of the discrete unit pulse. 
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THEOREM 15.3 


EXAMPLE 15.6 


one may thus expect that reconstructing an arbitrary signal /(f) by linear interpola¬ 
tion will result in the following representation of the signal frit): 

oo 

/r(0= flk]q T (t-kT). 

&=—oo 

That this is indeed the case is expressed by the following theorem. 

Let f[n] be the sampling of f(t) with sampling period T and let frit) be the 
continuous-time signal obtained from f[n\ by linear interpolation. Then 

oo 

frit) = ]T mqjit-kT). 
lc=—oo 


Proof 

We have to show that on an interval I of the form [nT, (n + 1)7] the graph of 
frit) consists of the line element connecting the points inT, finT)) and 
((n + 1)7, fiin + 1)7’)). Note that on the interval I only the triangular pulses 
qpit — kT ) with k = n and k — n + 1 are unequal to 0. Hence one has for tel 
that 


frit) = f[n]q T it - nT) + f[n + \]qrit ~ in + 1)7’). 

The graph of frit) on the interval I is thus a straight line and we have, moreover, 
that 


frinT) = f[n]q T iO) + f[n + 1 ]q T i~T) = f[n ], 

Min + 1)7) = f[n]q T iT) + f[n + l] 9r (0) = f[n + 1], 


This proves the theorem. g 

sin(fff) 

Consider the signal fit) = -- with a > 0. When sampled with sampling 

frequency a> s = 2a, and then reconstructed by linear interpolation, it will lead to 
the following signal frit): 


a sin(/t7r) 

fin] = - 

nn 


= 0 


/[ 0 ] = «, 


frit ) = aq T it). 


for n rf 0, 




From figure 15.6 we can see that linear interpolation can result in a reasonable ap¬ 
proximation of fit) if the sampling frequency is sufficiently large. A disadvantage 
is the fact that the graph of the signal frit) may have sharp turns at t = nT, which 
will lead to non-negligible contributions to the high-frequency components in the 
spectrum of frit ) (see section 4.2 in chapter 4). These high-frequency components 
may not even occur at all in the spectrum of the original signal fit). Even if the 
reconstruction in the time domain is satisfactory at high sampling frequencies, there 
may still be considerable deviations in the frequency domain. Especially for signals 
with spectrum Fico) = 0 for | co \ greater than some specific value, linear interpo¬ 
lation will usually give a bad approximation in the frequency domain. In the next 
section we will derive that for these signals, the so-called band-limited signals (see 
definition 15.4), there exists a reconstruction method which, for a sufficiently high 
sampling frequency, yields exactly the original signal, meaning that frit) — fit) 
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for all (el. Here, the reconstruction formula again has the form 

oo 

M) — J2 limit ~kT). 
k=—oo 

However, the signal 'l'(f) is no longer the triangular pulse function qj(t ), but a 
signal that is band-limited as well. 

EXERCISE 

15.6 Let pp(t) be the rectangular pulse function defined in (6.10) and let fit ) be a 

continuous-time signal. Consider the reconstruction formula 

oo 

frit) — J2 mprit-kT). 
k=—oo 

Sketch the graph of frit). Note: this reconstruction formula is sometimes called 
zero-order interpolation. 


DEFINITION 15.4 
Band-limited signal 

EXAMPLE 15.7 


Nyquist frequency 
Sampling condition 


15.3 The sampling theorem 

In this section we will derive a reconstruction formula which, for a sufficiently high 
sampling frequency, gives an exact reconstruction for band-limited signals. Band- 
limited signals are defined as follows. 

A signal f(t) with spectrum F(a >) is called band-limited if there exists an at c such 
that F(a>) — 0 for \ at \ > at c . 

sin (at) 

The signal /(f) = - with a > 0 has spectrum F(co) = np2a( a> ) ( see table 

3). This signal is band-limited: F(u>) = 0 for \a>\ > a. This band-limited signal 
sin (at) It will be used repeatedly in the reconstruction of signals, just as we have 
used the triangular pulse function qj (t ) in the previous section. ^ 

When a continuous-time signal f(t) does not contain frequencies greater than 
at c , that is, if F (at) = 0 for | at | > at c , then it will turn out that in a sampling with 
sampling frequency at$ > 2at c there is no loss of information. This then means that 
f(t) can be recovered completely from the values f[n\, in other words, that the 
signal f(t) is uniquely determined by the sampling /[«]. 

If ate is the smallest non-negative frequency such that F(a>) = 0 for | at | > 
at c , then 2 at c is called the Nyquist frequency. The condition at s > 2a> c is called 
the sampling condition. The limiting value o> s = 2 at c has the following plausible 
explanation. For the signal f(t) = sin(co c f) the spectrum F(at) is (see table 5) 

F(a>) — — (S(at - atc ) — 8(a) + at c ) ) ■ 

i 

The signal is band-limited: F(at) — 0 for | at | > at c . When we sample this signal 
with sampling frequency ai s = 2 at c , then f[n] = sin(nat c T) = sm(2njtat c /ats ) = 
sin(njr) = 0 for all integer n. Hence, the sampling /[«] is equal to the sampling of 
the null signal. However, the null signal is also band-limited. This means that /(f) 
is not uniquely determined by the samples if we use sampling frequency 2o> c , and 
so we have to choose a higher sampling frequency. 

Loosely formulated, the Nyquist frequency equals twice the highest frequency 
occurring in a signal. If the sampling frequency is higher than the Nyquist fre¬ 
quency, then /(f) can be reconstructed completely from the sampling f[n\. For the 
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THEOREM 15.4 
Sampling theorem 


Step 1 


a 


-w 

b 


-to, 


Step 2 


reconstruction one uses the function sin (at)/t. This is formulated in the following 
theorem, which is called the sampling theorem or Shannon’s theorem. 

Let f(t) be a band-limited signal with Nyquist frequency 2a> c and let f[n] be the 
sampling of fit) at sampling frequency at s and sampling period T = 2n/co & . If the 
sampling frequency a>s satisfies the sampling condition a>s > 2a> c . then 


oo 

m= f [n] 

n=—oo 


2sin(a> s (f — nT)/2) 
a>s(t - nT) 


for (el. 


(15.3) 


Proof* 

The proof is divided into a number of steps. The proofs of any of these steps can be 
omitted without loss of continuity. One then only gets a general idea of the proof of 
the sampling theorem. 

Introduce the function 

oo 

F s (a>) = ^ F(a) - kco s ). 

k=—oo 

The function F s (co) is a periodic function of at with period <d s and fundamental 
frequency 2n/co s = T (see section 7.3). As an illustration we have drawn the 
graphs of F s (a>), for a certain given F(co), in figure 15.8. In figure 15.8a we have 
a>s > 2a>c, while this is not the case in figure 15.8b. For the case o> s > 2&> c we see 



FIGURE 15.8 

The spectrum F s (aj ) for a> s > 2 co c (a) and co s < 2a> c (b). 


that F s (a >) is nothing else but the periodic extension of F(co) with period a> s to the 
entire co-axis, and so we have F s (co) = F(co) for —co s /2 < co < co s /2. In all cases 
we have on the interval [— co s /2, w s /2] that F s (o>) is a sum of finitely many shifted 
copies of Fled). 

Prove that 

oo 

F s (co) = T J2 f(nT)e~ inTa> . 
n =—oo 


(15.4) 
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Step 3 
Step 4 


Step 5 


EXAMPLE 15.8 


This result can be obtained by applying Poisson’s summation formula (7.22) to the 
function F s (o >): 

oo oo 

F s (co) = T J2 f(—nT)e inT( ° = F E f(nT)e~ inTo> . 

n=— oo n=—oo 

The identity in step 2 is valid for all a> s > 0 and for any band-limited signal whose 
spectrum is piecewise smooth. 

Our next step is to multiply the function F s (a>) by the rectangular pulse p Ms (w). 
This gives rise to the function F r (a>) = F^ico) po) s ia >). 

Prove that frit) -o- F r (a>), where 

2 sin(a> s t/2) 

frit) — E f[n]A>it-nT) with ¥(0=- —■ 


By applying some properties, transforming F r (a> ) back to the time domain results in 
the following signal frit): 


E f {nT) 


sin(a> s f/2) 

Tit 

sin(w s (f — nT)/2) 
n(t — nT) 

2sin(a> s (f — nT)/2) 
Wait - nT) 


•o Pw s (w), 


^ e~ in(oT Pro.ifo), 


^ T E f(nT)e- inojT p oh (ot), 


frit) ^ Frico). 


If w s > 2 a> c , then F r (w) = F(a>) and so / r (0 = fit). 

In this last step we have to show that frit) = fit) for all t e R. To show this, we 
will finally use the sampling condition a> s > 2a> c . Under this condition we have that 
F s (o>) = F)co) on the interval [—cu s /2, o> s /2] (see figure 15.8a). Hence, F(co) = 
F s ia>)pco s (at) for all co. From the uniqueness of the Fourier transform (theorem 7.4) 
it then follows immediately from an inverse transform that / r (f) = fit). 

In this proof we have assumed that F(o>) is a piecewise smooth function contain¬ 
ing no delta components. The sampling theorem also holds under less restrictive 
conditions. For example, F(w) may contain a number of delta components. We will 
no go into this any further. g 


skr (?rf) 

The signal fit) defined by fit) = --— has spectrum F( a>) = nqi^ (o>), where 

nt z 

qT-nim) is the triangular pulse function being 0 outside the interval [—2 n, 2rc\. The 
Nyquist frequency is thus equal to 47r. Hence, using a sampling with sampling 
frequency a> s > 4 n it is possible to give an exact reconstruction of the signal. For 
the sampling period T one then has 2n /T > 47r, so T < 1/2. This is satisfied by 
T = 1/4. For this value of T the reconstruction formula reads as follows: 


fit) 


oo 

E 

n=—oo 


sin 2 (n7r/4) sin(47r(f — n/A)) 
nn 2 Anit — n/A) 


i 6 

“ ^2 2 ^ 
n=—oo 


(—1)" sin 2 («7r/4) iiniAnt) 
n 2 iAt — n) 


◄ 
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EXAMPLE 15.9 


EXAMPLE 15.10 


The continuous-time signal /(f) = cos(o>of + 4>q) is sampled with sampling fre¬ 
quency w s . Next, the signal is recovered from the samples using the reconstruction 
formula from the sampling theorem. The spectrum of /(f) can easily be obtained 
using some properties. The result is: F(a>) = n[e‘^°S(a> — coq) + e~' < l >0 S(cL) + coq)]. 
The signal /(f) is thus band-limited with Nyquist frequency 2o>q. From the sam¬ 
pling theorem it then follows that for a> s > 2oiq the reconstruction will give us the 
original signal back again. ^ 


Human hearing will only register sound signals having frequencies that in general 
do not exceed the 20 kHz limit. This means that audible sound signals can approxi¬ 
mately be considered as band-limited signals with a Nyquist frequency 80 0007T. In 
order to sample audio signals without loss of information, one should use at least 
40 000 samples per second. A compact disc, which essentially contains a sampling 
of an audio signal, will have to satisfy this condition. ^ 


In principle, all the information in a band-limited signal should be contained 
in a sampling, provided that the sampling frequency is sufficiently large. A nice 
illustration of this fact is the energy-content. Let us assume that a given band-limited 
signal is an energy-signal. One should then be able to express the energy-content in 
terms of f[n\. This can be done as follows. Parseval's identity for continuous-time 
signals states that (see (7.19)) 

/ OO ] n CO 

\f(t)\ 2 dt=— / \F(co)\ 2 dco. 

-OO ^ J — OO 

The signal is band-limited and a > s > 2 a> c , and using the functions introduced in the 
proof of the sampling theorem we can thus write down the following identity for the 
energy-content E : 

, i r l 2°>s , 

2 dco=— I F s (a>) | 2 dm. 

T(V S J-\a> s 

The function F s (a >) is periodic with period co s and so we can again apply Parseval’s 
theorem, but now for periodic functions, which results in: 

I OO 

E = j J2 i c »i 2 - 

n =—oo 


i r \ a 

2jt J-h 


E 2tt / I 


I F(co) | 


In step 2 of the proof of the sampling theorem we saw that c n = Tf(-nT). From 
this we then obtain the desired expression: 

oo oo 

E = T J2 I f{~nT)\ 2 = T J2 l/["]| 2 - 
n=— oo H ——oo 


Up to the factor T this is the energy-content of the discrete-time signal f[n\. 


EXERCISES 

15.7 Let a band-limited signal (p(t) be given. Show that for any signal f(t) the convolu¬ 

tion product (/ * /)(f) is also band-limited. 

15.8* The spectrum F(a >) of a signal is given by F(a>) — Give a sketch of F s (a >) 

for a> s = 3n/2. 
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EXAMPLE 


Aliasing problem 


15.9 The spectrum F{a>) of a signal is given by F(a>) = P{u>)p u>& {(o). Here Pico) is a 

periodic function with period n and Fourier coefficients c n given by 

_ | 1 for | n | = 1, 

( 0 otherwise. 

Calculate the inverse Fourier transform of F{co). 

15.10 Given is the signal f(t ) with spectrum F(a >) = (p n * P 2 ti)(u>). For which values 

of the sampling period T can one reconstruct the signal from the sampling without 
loss of information? 


15.4 The aliasing problem* 

In this section we will look at the consequences of a sampling with a sampling 
frequency which is too low. This is a situation occurring often in practice. We will 
start with a simple example. 

Using a tv-camera we record a rotating wheel having angular velocity cuq, that is 
to say, having a speed of /q = coq/Itt revolutions per second. We assume that the 
camera has frequency 25 Hz. This means that the camera produces 25 images per 
second of the wheel. If we also have /q = 25 Hz, then the camera always produces 
the same image. We do not see the rotation of the wheel; the angular frequency of the 
observed wheel is then equal to 0. If the angular velocity a>o of the wheel changes, 
then the direction of the observed rotation may even be opposite to the actual rotation 
of the wheel. The phenomenon occurring in this simple example can be considered 
as a consequence of a sampling with a sampling frequency which is too low. In order 
to understand this, we associate the continuous-time signal e lu>ot with the rotating 
wheel. The sequence of images produced by the camera can be considered as a 
sampling of this signal with sampling frequency a>o — 50 it. This is the camera 
frequency converted to an angular frequency. Finally, we consider the observed 
rotation as a reconstruction of this sampling. Apparently, the reconstruction leads to 
a signal having a different angular frequency. ^ 

In this example the sampling condition is not satisfied. This is because the 
Nyquist frequency of e ,a>ot is 2coq and in this example we have a> s < 2 wq. We 
can determine which frequency is observed by consulting, for example, the proof of 
the sampling theorem. In step 4 it says that the spectrum of the reconstructed signal 
frit) is given by 

oo 

frit) o Frico) = F s (a>) («) where F s (co) = ^ Fici)-kto s ). 

k=—oo 

Due to the construction of F s (co), high-frequency components in Fia>) may end up 
in the interval / = [—a> s /2, a) s /2] by the shifts over a distance ka> s . The problem 
thus arising is called the aliasing problem. The function F s (a>) of our example is 
drawn in figure 15.9. By shifting over a distance ka> s , the frequency component 
with frequency wq ends up in the interval I at position &> r . (We will not consider 
the situation where components end up in the endpoints of the interval.) The recon¬ 
structed signal is a signal containing only the frequency co r . The frequency co r can 
be interpreted as the angular frequency of the observed wheel. 

In practice, when sampling audio for example, one will first lead the signal 
through a low-pass filter with a cut-off frequency, that is, the highest frequency 
that will pass through the filter, equal to half the sampling frequency. This avoids 
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-co s /2 


0 co r co s /2 


© s co 0 


co 


FIGURE 15.9 
Reconstruction of 

the annoying aspect of the ‘seeping through’ of high-frequency components that are 
present in the original signal. Here one should take in mind, for example, a music 
recording in a room where a bat is present, but remaining unnoticed. Without the 
low-pass filter this could lead to a hum in the recording. 

EXERCISES 

The periodic signal f(t) = cos(o>ol+ 0o) is sampled with sampling frequency a> s — 
3 o>q/2 and then reconstructed with the reconstruction formula from the sampling 
theorem. Determine the reconstruction. 

Given is a signal /(f) with spectrum F(a> ) = p n {(o). The signal is sampled with 
different sampling periods T and then reconstructed using the reconstruction for¬ 
mula from the sampling theorem. Determine the reconstruction / r (f) for each of the 
following sampling periods: 
a T = 4/3, 
b T = 2, 
c T = 8/3. 

SUMMARY 

Discrete-time signals can in general be described as a superposition of shifted dis¬ 
crete unit pulses. In particular, the periodic discrete-time signals can be described 
as a superposition of periodic trains of discrete unit pulses. Of importance are the 
discrete-time signals arising from a sampling of a continuous-time signal. Such a 
discrete-time signal is given by /[«] = f(nT), where T is the sampling period and 
a> s = 27r / T is the sampling frequency. 

One of the important problems in signal theory is choosing the sampling fre¬ 
quency in such a way that the continuous-time signal /(f) can be reconstructed from 
the samples /[«] without loss of information. That this is possible for band-limited 
signals is expressed by the so-called sampling theorem or Shannon’s theorem. It 
states that if the sampling frequency a> s satisfies the sampling condition co s > 2a> c , 
where &> c is the highest frequency occurring in the signal, then 


oo 


2sin(a> s (f — nT)/2) 
a>s(f - nT) 



The frequency 2a> c is called the Nyquist frequency. According to the sampling con¬ 
dition the Nyquist frequency should be a lower bound for the sampling frequency. 
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15.13 


15.14* 


-7ji/2 


15.15 


In practice the sampling condition is often not satisfied. Problems arising from 
this are called aliasing problems. High-frequency components in the original sig¬ 
nal can end up as low-frequency components in the reconstruction. It is therefore 
important to know how the reconstruction proceeds in the frequency domain. By 
first leading the continuous-time signal through a low-pass filter, one can avoid the 
aliasing problem. 


SELFTEST 


Given is a linear time-invariant system with frequency response H(a>) = q n ( a >). 
a Determine the impulse response. 

b To the system we apply a band-limited signal u(t) with Nyquist frequency n. 
Show that the response y(f) is also band-limited. In which band lie the frequencies 
of the output signal? Justify your answer. 

c For an input a sampling u[n] with sampling period T = 1 is available, given by 


u[n] 


: for n = 0 , | n | = 1 , 
0 otherwise. 


Calculate the response y{t). 

The spectrum F(a>) of a signal /(f) is represented by the graph of figure 15.10. 
a Calculate /(f). 

b The signal is sampled with sampling frequency co s . For which values of a> s can 
one reconstruct the signal without loss of information? Justify your answer. 


1 


- t> -I- t -i-4- t> -I-«-1-c-I-I-i-► 

-5n/2 -3ji/ 2 -Jt - 7 i /2 0 n/2 k 3k/2 5ti/2 7ji/2 

FIGURE 15.10 

The spectrum F(a >)of exercise 15.14. 

c Let T = 1 be the sampling period and /[«] = f(nT). Calculate the reconstruc¬ 
tion /r(f) given by 

^ 2 si n(aV/2) 

/ r (l)= > finYHt-nT) with ^(f) = - ' . 

n^oo ^ 

A periodic signal /(f) with period 2 n is sampled with sampling period T = n /2. 
a Show that 

3 

f[n] = Y, /W 5 4t» - kl 
k=0 

b The given periodic signal is band-limited with Nyquist frequency 3. Moreover, 
it is given that f(—n/2) = f(n/2) = 1, /(0) = f(n) = 0. Show that /(f) is 
completely determined by these values. 

c Show that the line spectrum c n of /(f) satisfies c n = 0 for | n \ > 2. 
d Calculate cq. 
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15.16 


The spectrum F(u>) of the continuous-time signal fit) is given by F(a >) = 
Pin (<w) cos The signal is sampled with sampling period T = 2/3. 
a Is it possible to reconstruct /(f) completely using the sampling f\n] = f(nT)l 
Justify your answer. 

b Determine the sampling /[«] for n = 0, ±1, ±2, .... 
c Show that 



oo 

f(t)dt=T J2 /["]■ 
n =— oo 


d Calculate the energy-content of f(t). 



Contents of Chapter 16 


The discrete Fourier transform 

Introduction 356 

16.1 Introduction and definition of the discrete Fourier transform 356 

16.1.1 Trapezoidal rule for periodic functions 357 

16.1.2 An approximation of the Fourier coefficients 358 

16.1.3 Definition of the discrete Fourier transform 359 

16.2 Fundamental theorem of the discrete Fourier transform 362 

16.3 Properties of the discrete Fourier transform 364 

16.3.1 Linearity 364 

16.3.2 Reciprocity 364 

16.3.3 Time reversal 365 

16.3.4 Conjugation 365 

16.3.5 Shift in the n -domain 366 

16.3.6 Shift in the F-domain 368 
16.4 Cyclical convolution 368 

Summary 371 

Selftest 372 



CHAPTER 16 


The discrete Fourier transform 


INTRODUCTION 


From parts 2 and 3 it is obvious that Fourier series and Fourier integrals play an 
important role in the analysis of continuous-time signals. In many cases we are 
forced to calculate the Fourier coefficients or the Fourier integral on the basis of a 
given sampling of the signal. We are therefore interested in a transformation that 
will transform a discrete-time signal, in this case a sampling, directly into the fre¬ 
quency domain. In general, such transformations are called discrete transforms. A 
particularly important discrete transform is the so-called discrete Fourier transform , 
abbreviated as DFT. and it will be the central theme of the present chapter. It arises 
naturally if one approximates the Fourier coefficients of a periodic continuous-time 
signal numerically using the trapezoidal rule. This is the subject of the first section 
of this chapter, which also introduces the DFT as a transform defined for periodic 
discrete-time signals. In the next section we introduce the inverse DFT in the so- 
called fundamental theorem of the discrete Fourier transform, which very much 
resembles the fundamental theorem of Fourier series. In the remaining sections, all 
kinds of properties of the DFT are treated, and again we will encounter many sim¬ 
ilarities with Fourier series and Fourier integrals. For example, one can formulate 
a Parseval theorem for periodic discrete-time signals. Following the introduction of 
the so-called cyclical convolution we can derive convolution theorems, which look 
very similar to the ones derived for continuous-time signals. Further applications of 
the DFT will not be considered until the next chapter, where we pay special attention 
to an efficient algorithm for the calculation of the DFT. 

LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know the definition of the discrete Fourier transform (DFT) 

- can relate the DFT to the Fourier coefficients 

- can formulate and prove the fundamental theorem of the discrete Fourier transform 

- can apply the most frequently occurring properties of the DFT 

- can calculate the DFT for some simple signals 

- know the definition of the cyclical convolution 

- can formulate, prove and apply the convolution theorems in the n- domain and the 
k-domain 

- know Parseval’s theorem for periodic discrete-time signals and can apply it to 
calculate the power of a periodic discrete-time signal. 


16.1 Introduction and definition of the discrete Fourier transform 

In this section we introduce a discrete transform for periodic discrete-time signals. 
Periodic discrete-time signals can for instance be obtained by sampling a periodic 
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continuous-time signal with period T using a sampling frequency a> s equal to an 
integer multiple of the fundamental frequency coq = 2tc/T of /(f), so a> s = Nwq 
for some integer N > 0. There are then N samples in the interval [0, T ) and the 
sampling f[n] = f(nT/N ) is, moreover, periodic with period N. Note that the 
sampling period is then equal to T/N. Using the sampling /[«] we would now like 
to give an approximation for the Fourier coefficients c* of the signal /(f). For this 
we use the trapezoidal rule for the numerical approximation of integrals. 


Trapezoidal rule 


16.1.1 Trapezoidal rule for periodic functions 


Let git) be a periodic function with period T whose integral over the interval [0, T\ 
needs to be calculated. We start by dividing the interval of integration [0, T] into 
the subintervals /„ of equal length T/N: 


(n - 1 )T nT 
N ’ ~N 


for n = 1 , 2 , 


On each subinterval I n we replace git) by the linear interpolation by the linear 
function l n it) given by 


N 


hi it ) = — ( g[n - 1J ( — - f ) + g[n] 


nT 


^)) 


Note that in the case when git) is real-valued, the graph of (f) consists of the 
line element connecting the points (in — l)T/N, g[n — 1]) and (nT/N, g[n]) (see 


0(f) 



FIGURE 16.1 

Approximation of a function by linear interpolation. 


figure 16.1). Next we approximate the integral of g(t) over the interval I n by 

rnT/N rnT/N t 

/ g(t)dt& l n (t)dt = ——(g[n — 1] + g[n]). 

J(n-\)T/N J(n-V)T/N ZN 

By summing all of these approximations over the interval [0, T ] we obtain the so- 
called trapezoidal rule: 

f-T N miT/N N t 

/ g(t)dt = J2 S(0dt ss “ !] + £[”]) 

Jo £r[J(n-l)T/N 

= + 2g[l] + • • • + 2 g[N - 1] + g[N]). 

Now it is given that g(t) is periodic, so g[0] = g[iV], and hence 

[ T g(t)dt* l(g[0] + g[l] + ... + g[JV- 1]). 

Jo N 


(16.1) 
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Observe that in (16.1) we have an elementary Riemann sum in which all function 
values have been taken in the left endpoint of the subintervals. We know that for 
Riemann integrable functions the Riemann sums will converge to the value of the 
Riemann integral if we let the length of the subintervals decrease. But piecewise 
smooth functions are Riemann integrable. For piecewise smooth signals we thus 
have 

^(*[0]+ *[!] + ■■■ + «[#-I])-*- [ T 8(t)dt when N -*■ oo. (16.2) 

N Jo 

Hence, (16.1) gives an approximation of the integral over one period, starting from 
a sampling g[n\ of the function g(t). 


16.1.2 An approximation of the Fourier coefficients 


The Fourier coefficients of a periodic function fit) can be calculated from (see 
section 3.2.2) 

c k = | f T f(t)e- ik(O0 ‘dt. 

T Jo 

Applying the trapezoidal rule (16.1) with the integrand being the periodic function 
g{t) = f(t)e~' ka>ot with coq = 2 jt/T, we obtain the following approximation for 
the Fourier coefficient c\\ 


Ck^~J2fMe- ika)onT/N 

n =0 

The sum is written as F[k\, so 
N -1 

F[k\ = J2 f[n}e - 2nink/N , 

n =0 


-J- J2 f[n]e~ 2 ” ink ' N . 

" n=0 


and hence it follows that 

c k ™^F[k]. (16.3) 

From (16.2) we know that F[k\/N -*■ Ck if IV —>■ oo. For a given value of k 
the quotient F[k\/N will be a good approximation of Q. for sufficiently large N. 
However, how large N should be in order to get a specific degree of accuracy for 
the approximation of Ck will in general not only depend on f(t ) but also on the 
value of k. We do not intend to go into this matter any further in this book. It is 
immediately clear however, that after a value of N is chosen, F[k\/N cannot be a 
good approximation of t'k for all k. This is because the sequence F[k] is periodic 
with period N, while for piecewise smooth signals we have Ck —> 0 for \ k\ -*■ oo. 
The periodicity of the sequence F[k] can be verified by a substitution: 

F[k + N] = f[n]e~ 2nin{k+N)/N = f\n\e~ 27link/N = F[k]. 

n=0 n=0 


Here we used the relation 

2nin(k-\-N)/N _ —2nink/N e —2nin _ e —2nink/N 



16.1 The DFT: introduction and definition 


359 


EXAMPLE 16.1 


In the following example we approximate the Fourier coefficients of a periodic func¬ 
tion by applying (16.3). 

Consider the periodic continuous-time signal f{t) with period 2n, given on the 
interval [0, 2:rr] by 


It is easy to verify that this is an even signal. For this signal the Fourier coefficients 
can be calculated explicitly (perform these calculations yourself). They have the 
following values: 

r 2 

-- for k odd, 

| (7 Tk) 2 

for k = 0. 
for k 0 and even. 

We want to compare these Fourier coefficients with the numbers F[k]/N corre¬ 
sponding to the sampling at the points 2nn/N with N — 128 and calculated ac¬ 
cording to (16.3). The results are listed in table 16.1. 

TABLE 16.1 The Fourier coefficients and the approximation F[k\/N. 



k 

Ck 

F[k]/N 

00 

+0.50000 

+0.50000 

01 

-0.202 64 

-0.202 64 

03 

-0.022 51 

-0.022 56 

05 

-0.008 11 

-0.008 15 


59 

-0.00006 

-0.000 12 

61 

-0.00005 

-0.000 12 

63 

-0.00005 

-0.000 12 


The values given here were rounded off after the fifth decimal place. The Fourier 
coefficients with an even index unequal to 0 have been omitted since these are all 
0. After all. the signal is even. Here we also have F[fc] = F[—k\ for all k e Z, as 
is the case for the Fourier coefficients in this example. In section 16.3 we will see 
that this follows from a symmetry property. Note that for small values of k we get a 
good approximation. ^ 

In general, the numbers F[k]/N with \ k\ < N/2 are used as an approximation 
for C£. It is important, though, that at the points where /(f) has a jump the sampling 
is given the value ( f(t +) + f(t—))/2. For example, /[0] = (/(0+) + f(T —))/2. 


16.1.3 Definition of the discrete Fourier transform 

We have seen that the sequence F[k\ plays an important role in the approximation 
of the Fourier coefficients of a periodic signal /(f) from a sampling f\n\. But its 
importance is not restricted to the determination of the Fourier coefficients. Else¬ 
where in signal theory, one will often encounter this sequence as well. There is thus 
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DEFINITION 16.1 

N-point discrete Fourier 
transform 


N-point DFT 


k-domain 
n-domain 

Frequency domain 
Discrete spectrum 


LEMMA 16.1 


ample reason to study this sequence in more detail and also to give it a name, as will 
be done in the following definition. 

Let f[n\ be a periodic discrete-time signal with period N. The sequence F[k] de¬ 
fined by 

N -1 

F[k]= J2 fl n \e~ 27link/N forked (16.4) 

n=0 

is called the A-point discrete Fourier transform of f[n]. 

The transform assigning the IV-point discrete Fourier transform F[k] to the signal 
f[n] is called the (V-point discrete Fourier transform, which is abbreviated as DFT. 
If it is clear from the context what the number of points in the DFT should be. then 
we will usually omit the additional ‘IV-point’. 

We have seen that the sequence F[k] is periodic with period N. Hence, consid¬ 
ered as a discrete signal, F[k] is again a periodic discrete signal. Hence, the DFT 
converts a periodic discrete signal into a periodic discrete signal again having the 
same period. 

In the next section it will be shown that the signal f[n] can be recovered from 
F[k] by means of the inverse DFT. Hence, if F\k] is known, then in principle /[/;] 
is also known. We will call F[k\ the description of the signal in the so-called k- 
domain , and /[«] the description in the n-domain or time domain. Because of the 
close relationship of F[k ] with the Fourier coefficients, the k-domain is also called 
the frequency domain , and F[k] the discrete spectrum of f[n\. Finally, as for the 
continuous-time signals, we denote the transform pair /[«], F[k] by 

fin] ** F[k|. 

It is easy to show that the DFT is a linear transformation. Hence, if 
/l [n] F] |k] and f 2 [n] F 2 [k], 

then one has for arbitrary complex a and b that 

af\[n] + bf 2 \n\ ++ aF l [k] + bF 2 [k]. (16.5) 

We close this section with a property of periodic discrete-time signals that may 
sometimes be useful when calculating the F[k], The property implies that if the 
values of the signal over one full period are added together, then the outcome is the 
same regardless of the starting point of this summation over one full period. This 
property is formulated in the following lemma. 

Let g[ri\ be a periodic discrete signal with period N. Then one has for any integer 
j that 

j+N-l N -1 

gW = «[«]• 

n=j n=0 

Proof 

Let the integers I and m be given by the relationship j = mN + /, where 0 < 1 < 
N — 1. Note that this determines / and m uniquely. Because of the periodicity of 
g[n] one then has 

j+N-l 

sin] = g[j ] + g[j + 1] + ■ ■ ■ + glj + N - 1] 

n=j 


= 8V] + • • • + g[(v - 1] + g[ATj + ... + g[N + l- 1] 
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= g[l] + ■■■ + *[#-!] + g[0] + ■■■ + *[/- 1] 


N -1 


= g[0] + g[l] + ■ ■ ■ + g[N - 1] = £ g[n], 

n =0 


Lemma 16.1 can immediately be applied to the DFT since the general term in 
the representation of F[T] as a sum is periodic, as a function of n, with period N. 
Among other things it implies that the DFT for N — 2 M + 1 can also be given by 

M 

F[k\ = J2 f[n]e~ 27link/N . 

n=—M 

A periodic discrete-time signal /[;;] with period 5 is given by /[—2] = — 1, 
/[-l] = -2, /[0] = 0, /[ 1] = 2, /[2] = 1. The 5-point DFT can be calcu¬ 
lated as follows: 

F[k} = -e 471 ' 1 '*/ 5 - 2 e 2jr, ' i '/5 + 2 e ~ lnik / 5 + e ~ Anik / 5 
= — 2 i sin(47r^/5) — 4 i sin(2jrfc/5). 

◄ 

Note that the DFT in example 16.2 is purely imaginary. This has to do with the 
fact that /[;;] is an odd and real signal. Just as for the Fourier coefficients, the DFT 
has similar symmetry properties, as will be shown in section 16.3. 

EXERCISES 

16.1 Show that for the 2-point DFT of a periodic discrete-time signal f[n] with period 2 
one has F[k] = /[0] + (-1)*/[1], 

16.2 Calculate the 2-point and 4-point DFT of the discrete-time signal f\n\ = (—1)" for 
n e Z. 

16.3 The periodic continuous-time signal f(t) with period T is given on the interval 
[0. F] by the graph of figure 16.2. Calculate the Fourier coefficients of f{t) and 
compare cq with the value F[0] of the IV-point DFT of f[n\. 


T?- 

1 

I 

-T 



-;- 

-c- 

♦- 

-► 


0 772 T t 

FIGURE 16.2 

Graph of the periodic function from exercise 16.3. 

16.4 The periodic continuous-time signal f(t) with period T is given by the graph from 
figure 16.3. Calculate the Fourier coefficients of f{t) and compare co with the value 
F[0] of the IV-point DFT of f[n\. 

16.5 In the previous two exercises 16.3 and 16.4, the continuous-time signals only differ 
at the jump discontinuity. Which of the values at these jumps do you prefer? Justify 
your answer. 
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1 ? - ? 

1/2 * 1/2 * • 

-i- i -v-► 

0 772 T t 


FIGURE 16.3 

Graph of the periodic function from exercise 16.4. 


16.6 A periodic discrete-time signal /[n] with period 4 is given by /[—2] = 1, /[—1] = 

0, /[0] = 2, /[l] = 0. Calculate the 4-point DFT of /[«]. 


16.2 Fundamental theorem of the discrete Fourier transform 


In the previous section the notation f[n] -o- F[k\ already alluded to the fact that a 
periodic discrete-time signal f[n] can be reconstructed completely from its discrete 
spectrum F\k] or, formulated differently, that an inverse DFT exists. This is indeed 
the case, as will be shown in the present section. For this we will use an elegant 
property of the IVth roots of unity. These have been defined in section 2.1.2 as the 
roots in the complex plane of the equation z N = 1. If we now put w = e 2yT '/ N , 
then the N distinct roots Zj (j = 0, 1. N — 1) of this equation are given by 

zj = e 27ti i/ N = w J where j = 0, 1,..., N - 1. 

For arbitrary integer n one then has 


1 

N 


N -1 

E 


„2nink/N 


k=0 


1 

N 


N -1 

E wnk 


k=0 


1 


if n is an integer multiple of /V, 


1 l-w nN 
N 1 - w" 


= 0 


otherwise. 


Note that because of the definition of the periodic train of unit pulses (see dehnition 
15.2), this property can also be written as 


N—l 


5 ^ [ " ] = Jj ^ 
*=0 


\ ^ 27cink/N 


for n e 


(16.6) 


We use this property to prove the following theorem. In this theorem we introduce 
the inverse DFT. 


THEOREM 16.1 

Fundamental theorem of the 
discrete Fourier transform 


Let f[n] be a periodic discrete-time signal with period N and DFT F[k] given by 
F[k] = XlEo f[n]e~ 2nink / N . Then one has for all integer n that 

/[«] = ^ E F[k]e 2jri " k/N . 

™ k=0 


(16.7) 
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Inverse DFT 


Fundamental frequency 


EXAMPLE 16.3 


EXAMPLE 16.4 


Proof 

Substitution of F[T] into the sum in the right-hand side of (16.7) gives 


1 

N 


J2 F[k\e 2nink ' N 


k=0 


, N-lN-l 

4 EE 


1 

N 


N -1 N -1 

E m E <P* ikln ~ l)IN 

1=0 k=0 


IV-1 


= E f^N\n - l] = /(«)■ 

1=0 

Here we have used (16.6) following the change in the order of summation. This 
completes the proof. g 


Identity (16.7) shows how the signal /[;;] can be recovered from F[k], The trans¬ 
formation assigning the signal f\n\ to F[k] is called the inverse discrete Fourier 
transform. From identity (16.7) it also follows that an arbitrary periodic discrete¬ 
time signal / [«| with period N can be written as a linear combination of the time- 
harmonic signals gk[n] = g-^ink/N^ where £ = 0, 1, ..., N — 1, which are them¬ 
selves periodic with period N. 

The fundamental theorem of the DFT is very similar to the fundamental theorem 
of Fourier series. In the latter theorem, a periodic continuous-time signal with pe¬ 
riod T and fundamental frequency a>o = 2tz/T is written as a superposition of the 
time-harmonic continuous-time signals e' kt ° ot , where k e Z. For periodic discrete¬ 
time signals it is now quite appropriate to call the quantity 2 n/N the fundamental 
frequency. The discrete signal e 27r ' nk / N ^ considered as function of n, then has fre¬ 
quency 2nk/N, which is an integer multiple of 2n/N. Since 

e 27Tin(k+N)/N = e 2nink/N for aU „ g Z> 

only finitely ( N ) many frequencies can be distinguished in the discrete-time situa¬ 
tion. Hence, the sum occurring in the fundamental theorem of the DFT only con¬ 
tains a finite number of terms, which is in contrast to the Fourier series of a periodic 
continuous-time signal. 

As a first example we consider the periodic train of unit pulses <5,y [«]■ The DFT of 
<5/v[n] follows immediately from the definition of 5^[n] (verify this), and results in 

<5;v[w] «-»• F[k\ = 1. (16.8) 

We see here that the DFT of the periodic train of discrete unit pulses is equal to 
the constant discrete signal 1. The Fourier coefficients of the periodic train of delta 
functions with period 2n are also mutually equal (verify this). Again we note the 
similarity between the DFT and the Fourier coefficients. Applying theorem 16.1 
gives 

« = i E e “ /iV - 

N k =0 

Here we see (16.6) re-appearing. ^ 

Calculating the DFT of the periodic discrete-time signal //[/;] = e- 7T ' nl / N with 
period N is an immediate application of (16.6). The result is 

fl\n\ = e 2lzinl ' N NS N [l - k]. 
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Applying theorem 16.1 then gives: 

f,[n] = S N [l - k]e lnink l N = e 2ninl l N . 
k =0 

This indeed recovers //[«]. ^ 

In general, F[k] will of course be complex. As for continuous-time signals we 
Amplitude spectrum call the modulus | F[A] | of the spectrum F\k] the amplitude spectrum and arg F[A] 

Phase spectrum the phase spectrum of f[n]. The phase spectrum is determined up to a multiple of 

2 71 . 

In the next section we consider some properties of the DFT. We will show, for 
example, that a shift in the n-domain does not change the amplitude spectrum of a 
discrete-time signal. 

EXERCISES 

16.7 Calculate the 4-point inverse DFT of the discrete signal F[A] with period 4 given by 
F[0] = 1, F[l] = 0, F[2] = 0, F[3] = 1. 

16.8 For a periodic discrete-time signal /[«] with period 4 the amplitude and phase spec¬ 
trum are given by | F[A] | = 2 and argF[A] = nk/2 respectively. Calculate f[n] 
for n = 1,2, 3,4. 

16.9 Given is the complex number z with z 0. The periodic discrete-time signal f[n\ 
with period A is given by f[n] = z n for n =0, 1, .... A — 1. Calculate the A-point 
DFT of f[n]. 

16.3 Properties of the discrete Fourier transform 

A large number of properties that we have encountered in the theory of Fourier series 
and integrals will return here. They will be treated in the present section. Moreover, 
they are summarized in table 12 at the back of the book. 


16.3.1 Linearity 

In the previous section we have already noted that the DFT is a linear transformation 
(see (16.5)). 


16.3.2 Reciprocity 

As in the case of the Fourier transform of continuous-time signals, the formulas for 
the DFT and the inverse DFT show a great similarity. As a consequence we can again 
formulate a reciprocity rule for the DFT. Let F[A] be the DFT of /[«]. We will now 
calculate the DFT of F[«|. The expression for the inverse DFT reads as follows: 

m = E nk]e 27iink/N . 

N k =0 

From this it follows, by interchanging the variables n and k. that 

m = W E nn]e 2nink ' N . 

N 11=0 
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Reciprocity 


EXAMPLE 16.5 


Time reversal 


Conjugation 


Replacing k by — k in this identity, we obtain the expression 
N -1 

F[n\e~ 2nink/N = Nf[—k], 

n =0 

Apparently, the DFT of F[ri\ is equal to Nf[—k], We formulate this as the reciprocity 
rule for the DFT: 

F[n] «> Nf[-k], (16.9) 

The DFT of the signal <5^[n] is the constant signal 1 (see (16.8)), so <5^[n] 1. 

From the reciprocity rule it follows that 1 -o- NSy/[—k]. Since 5jy[n] is an even 
signal (verify this yourself), we obtain that 1 <h> NSy/[k]. Written out in full this 
gives the expression 

N -1 

J2 e -2mnk/N = NSff[k] 
n =0 

and, after interchanging the variables, (16.6) again re-appears. ^ 


16.3.3 Time reversal 


By time reversal we will mean the operation in the n-domain which replaces n by 
— n, which implies that a reversal in time takes place. The result in the k-domain is 
easy: there will also be a reversal in frequency, which is summarized in 

f[-n] F[-k ]. (16.10) 


In fact, the DFT of the signal /[— n] equals 


J2 f[-n]e- 2ltink / N = f[N - n ] e 2xW-n)k/N = f[n]e 2nink ' N 
n =0 n =0 n= 1 

= n-ki 


Note that we used lemma 16.1 for the final equality in the calculation above. As a 
consequence we have for an even or odd periodic discrete-time signal that the DFT 
is also even or, respectively, odd. When, for example, f\n\ is even, then /[— n\ = 
/[/;] for all integer n and so we have F[—k\ = F[k] for all integer k. 


16.3.4 Conjugation 

The discrete spectrum of the complex conjugate f[n\ of a signal f[n] can be found 
by a direct calculation: 

TV— 1 T V^i 

J[n]e~ 2ltink/N = f[n\e 2jtink / N = F[-k], 
n =0 n =0 

Conjugation in the n-domain thus implies a conjugation in the fc-domain and a re¬ 
versal of frequency, that is to say, 


fin] F[-k], 


(16.11) 
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EXAMPLE 16.6 


Shift in the n-domain 


EXAMPLE 16.7 


For real signals this rule implies that the amplitude spectrum is an even function of 
k and that the phase spectrum is an odd function of k. In fact, if /[/?] is real, then 
f\n\ = /[n] and so F[—k] = F[k\, which means that 

| F[-k] I = | F\k\ | = I F[k] I 

and 


arg F[—k] = — arg F[—k] = — arg F\k], 

Moreover, real signals have the advantage that the amount of computation necessary 
to determine the DFT can be halved. Since F[£] is periodic with period A, one has 
for real signals /[;?] that F[N — k] = F[—k] = F[k]. This means that it suffices to 
calculate F[fc] for 0 < k < A/2. The values of F[k] for A/2 < k < A then follow 
by conjugation. 

In this example we return to section 16.1. In example 16.1 the Fourier coefficients 
of a periodic continuous-time signal have been determined using a 128-point DFT 
F[k\ (see table 16.1). Since the signal f(t) in example 16.1 is real and even, these 
properties also hold for the sampling f[n] and this implies that F[—k\ = F[k\ and 
F[— k] = F[k\. We conclude that F[k\ is also real and even. ^ 


16.3.5 Shift in the n-domain 


A discrete-time signal has been introduced as a function defined on the integers. 
Therefore, we can only allow a shift in the n-domain over an integer, say /. This 
is because if /[n] is a discrete-time signal, then for integer / the signal f[n — /] is 
again a discrete-time signal. A shift in the n-domain has the following consequence 
in the fc-domain: 

/[«-/]** e~ 2nilk/N F[F\. (16.12) 


One can prove this property as follows: 


J2 f [n _ i ]e ~2mnk/N 
n =0 


N J2 f[n\e~ 2niirl+l)k/N 

n=—l 

e -2Kilk/N f\n\ e - l7tinklN = e~ 2nilk/N F[k\. 
n =0 


In this calculation we have applied lemma 16.1. 

In this example we consider a sum of periodic trains of discrete unit pulses given by 

m 

f[n]= J2 s N[n~H 
l=—m 


where we assume that 2m < A. A graph of /[/?] is shown in figure 16.4. To 
calculate the DFT of /[«], we first use the linearity property (16.5). This means that 
for each term occurring in the description of f[n\ we take the DFT. By adding these, 
we obtain the DFT of /[«]. The DFT of S]^[n — l] immediately follows from (16.8) 
and the shift property (16.12) and results in 

S N [n-l] *+ e~ 27lilk /N. 
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FIGURE 16.4 

Sum of periodic trains of discrete unit pulses for m = 2 and N = 10. 


Hence, 


m 

f\n ] F[k] = J2 e ~ 2nilk/N . 

l——m 


This sum can be calculated explicitly. If, for convenience, we put z = e ~ 2ni k/N, 
then F[A] is the sum of a finite geometric series with initial term z ~ m , ratio z and 
final term z m ■ Hence, the sum F[k\ equals 


F[k] = 


2m + 1 

flnimk/H _ e —2ni{m+X)k/N 
l _ e —2nik/N 


if Ar is a multiple of N, 
otherwise. 


We rewrite the second expression as follows: 


flnimk/N _ e —2Tii{m+\)k/N e ni(2m + \)k/N _ e —ni(2m+\)kJN 
j _ e —27rik/N gjrik/N _ g—nik/N 

sm(n(2m + 1)A:/A^) 
sm{nk/N) 

The final result for F[k\ is then 


F\k] = 


2m + 1 

sin(7r(2m + 1) k/N) 
sin(7tk/N ) 


if k is a multiple of N, 
otherwise. 




From the shift property (16.12) it follows that the amplitude spectrum does not 
change under a shift in the n-domain, since 

| e -2nilk/N | = | | _ 

The phase spectrum changes in a simple way: 
alg ( e - 2 i r iIi/lV F [j t ]) _ arg(F[/t]) - 2nlk/N. 


Linear phase shift 


The change —2 Jtlk/N is linear in k. We then say that a shift in the n-domain causes 
a linear phase shift. 
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16.3.6 Shift in the k-domain 

Shift in the k-domain Similar to the n -domain, a shift in the k-domain will result in a multiplication by a 

complex exponential in the n -domain. Derive for yourself the following rule: 

e 2ninl/N f[n \ ^ F[k _ ^ (16.13) 

EXERCISES 

16.10 The periodic continuous-time signal /(f) with period 2jr from example 16.1 satis¬ 
fies the relation /(f) + /(f + tt) = 1 for all f el. 

a Prove this relation. 

b Show that for the given sampling with IV = 128 one has /[«] + f\n + N/2] — 1 
(n e Z). 

c Prove that the previous relation implies that F[k] = 0 for even k. except when 
k is an integer multiple of 128. What is F[k] when k is an integer multiple of 128? 

16.11 The periodic discrete-time signal f[n] is given by 

2m +1 if n is a multiple of N. 

fW = sin(jr(2m + l)n/N) 

- otherwise. 

sin(frn/lV) 

Determine the DFT of f[n\. 

16.12 Given is a real periodic discrete-time signal /[;?] with period 4. For the 4-point DFT 
F[k] of f[n] it is known that F[0] = 1, E[l] = i. F[ 2] = 0. Calculate f[n] for 
n = 0, 1,2,3. 


16.4 Cyclical convolution 

For both the Fourier series and the Fourier integrals we have encountered the convo¬ 
lution product, or convolution for short. In both cases the corresponding convolution 
theorems showed that the convolution operation in the time domain is related to a 
multiplication in the frequency domain. For the DFT we will again come across a 
convolution. 

Let the periodic discrete-time signals /[«] and g[n\ with period N and DFT F[k] 
and, respectively, G[k\ be given. We are then looking for a periodic discrete-time 
signal in the /(-domain whose spectrum equals the product F\k]G\k], This signal 
can be found as follows. Using definition 16.1 for the DFT we see that 

IV-1 

F[k]G[k] = J2 fV]G[k] e - 27Tilk / N . 

1=0 

The product F[k\G[k\ is written here as a linear combination of the signals 
f[I]G[k]e~ 2nilk ^ N . We subsequently apply the shift property (16.12), which re¬ 
sults in 

g[n - I] G[k\e~ 2nilk/N . 

The linearity property then gives 
N -1 

J2 /PM" - /] F[k]G[k]. 

1=0 
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DEFINITION 16.2 
Cyclical convolution 


THEOREM 16.2 
Convolution in the n-domain 


EXAMPLE 16.8 


THEOREM 16.3 
Convolution in the k-domain 


It is now clear how to define the convolution for periodic discrete-time signals. Since 
the convolution product is in the first instance meant for periodic signals, this prod¬ 
uct will be called the cyclical convolution product or cyclical convolution for short. 

The cyclical convolution product of two periodic discrete-time signals f\n | and g[n] 
with period N is the discrete-time signal (f * g)[n] defined by 

N- 1 

(/**)[*]=£/[/]*[«-/]• (16-14) 

1=0 

The corresponding convolution theorem, which has already been proven, can be 
formulated as follows. 

Let f[n] and g[n] be periodic discrete-time signals with period N. Let F[k\ be the 
DFT of f[n] and G[k] the DFT of g[n]. Then one has for the cyclical convolution 
product (f * g)[/i] that 

(f * g)[n] <+F[k]G[k]. (16.15) 

From theorem 16.2 it follows that cyclical convolution is commutative, that is to 
say, 

(/*g)M = (g */)[«] for n e Z. (16.16) 

In fact, the ordinary product in (16.14) is commutative, and so the left-hand and 
right-hand sides of (16.16) have the same DFT. 

In theorem 15.2 of chapter 15 we have seen that for a periodic discrete-time signal 
with period N one has 

IV-1 

f[n] = fin&Nl 1 ’ — l] forn e Z. 

1=0 

This result also follows easily from the convolution theorem. In the right-hand side 
we have the cyclical convolution of the signals &^\n\ and /[«]. Since i5/y[n] -o- 1, 
we have, according to theorem 16.2, 

N -1 

J2 mS N [n-l]** F[k] l = F[k]. 

1=0 

Theorem 15.2 now follows from the inverse transform. ^ 

Because of the close relationship between the DFT and the inverse DFT, we may 
expect that the DFT of a product /[/t]g[n] in the n-domain will result in a convolu¬ 
tion product in the fc-domain. This is indeed the case, as is stated in the following 
theorem. 

Let f[n] and g[n] be periodic discrete-time signals with period N. Let F\k] be the 
DFT of f[n] and G[k\ the DFT of g[n]. Then 

f[n]g[n] 4* * G)[kl (16.17) 

Proof 

We apply the inverse DFT to F[k], which results in 

f[n]g[n] = 1 £ F[l]e 2niln ' N g[n\. 

™ 1=0 
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EXAMPLE 16.9 


Power 


THEOREM 16.4 

Parseval’s theorem 


We have thus written the product /[/z]g[«] in the n-do main as a linear combination 
of the signals F\I]e 27: ' ln / N g\n], For these signals one can obtain the DFT by means 
of the shift property. We then find that 

F[l]e 27tiln/N g[n\ F[l]G[k - /]. 

Applying the linearity property, (16.17) follows, proving the theorem. g 

Let f[n] = e 2jlin / N and let g[n] be an arbitrary periodic discrete-time signal with 
period N. Assume that g[n] G[k], Since e 27T,n / N -o- NS^[k — 1], it follows 
from the convolution theorem in the A-domain that 
1 N -1 

e 27lin ' N g[n\ ^ - Y, NS N [I - 1 ]G[k - I] = G[k - 1], 

N 1=0 

As a matter of fact, this result can be obtained more quickly by applying the shift 
property (16.13) in the A-domain. ^ 


As the final subject of this chapter we consider the power of a periodic discrete¬ 
time signal. This has been introduced in chapter 1 as the quantity P satisfying 

, N -1 

»=0 

From the inverse DFT we know that a periodic discrete-time signal /[«] can be 
written as a linear combination of the signals e 27 rink/N ( see (jg 7 )) : 

f [n] = 77 E nk]e 2nink ' N . 

N k =0 

The power of the signal F[k]e 27T,nk / N /N in the n-domain equals [ F[k] \ 2 / N 2 
(check this yourself). An important consequence of our next theorem will be that 
the power of f[n\ is equal to the sum of the powers of the individual terms in the 
above expression for f[n] (see (16.19)). 

Let f[n\ and g[n ] be periodic discrete-time signals with period N. Let F[A] be the 
DFT of f[n] and G[A] the DFT of g[n]. Then 

N-l j N-l 

J2 mm = - ( 16 - 18 > 

n =0 k =0 

Proof 

In the left-hand side of (16.18) we substitute for f\n\ the inverse DFT of F[k] and 
we then change the order of summation, resulting in: 


N-l 


^2 fwsw 

n =0 


N-l 

E 

N-l 

J2 F[k]e 27tink/N 

n =0 

k =0 

N-l 

N-l 

E 

E W\e 2lTink/N 

k =0 

n =0 

N-l 

iV-l 

E 

F[k\ 22 g[n]e~ 27Tink / N 

k=0 

n =0 

N-l 


E 

k =0 

F[A]G[A]. 
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This proves the theorem. g 

Replacing g[ft] by /[«] we obtain from the theorem above that 
N -1 j N -1 

Y, l/[”]l 2 = T7 X) I^WI 2 - (16.19) 

h =0 £=0 


EXAMPLE 16.10 


16.13 

16.14 


16.15 


16.16 

16.17 


Let /[«] be the periodic discrete-time signal with period A given by /[ft] = 
sin(27rn/A). By changing to complex exponentials it follows that /[/?] = 
(g2nin/N _ / N )/2i. From this representation we immediately obtain the 

DFT of /[«]: 


A[-l] = —N/2i, 

A[l] = A/2/ 

A[0] = F[ 2] = A[3] = ... = F[A - 2] = 0. 

According to (16.19) the power of /[ft] is then equal to 

1 /a 2 A 2 \ _ 1 

P ~ A 2 y 4 + 4 J ~ 2 

◄ 

EXERCISES 

Let the periodic discrete-time signal /[ft] be given by /[ft] = 5yy[ft] + 5^[ft — 1], 
Calculate the cyclical convolution product of /[ft] with /[ft]. 

For the periodic discrete-time signal / [ft] with period N the A-point DFT is given by 
F[k] = cos(2nk/N) sin (4nk/N). Determine /[ft] using the convolution theorem 
16.2. 

Let /[ft] and g[ft] be periodic discrete-time signals with period N and with /[«] -o- 
F[k\ and g[n| G[k\. Prove the following duality property. 

N -1 N -1 

J2 fWG[n] = Y, nk]g[k]. 

n =0 k =0 


Determine the power of the periodic discrete-time signal f[n] whose DFT is given 
by F[k] = cos 2 {itk/N). 

Determine the power of the periodic discrete-time signal /[ft] with period N given 
by 


f[n ] = 


2m + 1 

sin(ft(2ft! + 1 )n/N) 
sin(7rft /N) 


if ft is a multiple of N, 
otherwise. 


Elere m is a positive integer with m < A/2. 


SUMMARY 

The discrete Fourier transform (DFT) assigns to a periodic discrete-time signal /[ft] 
with period A, given in the time domain or n-domain, a periodic discrete signal 
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16.18 


F[k\ in the frequency domain or fc-domain: 

N -1 

F[k] = J2 f[n]e~ 27link/N . 
n =0 

The DFT, also called the (discrete) spectrum of /[«], arises in a natural way if we 
pose the problem of approximating the Fourier coefficients of a periodic continuous¬ 
time signal using the trapezoidal rule. 

Through the inverse DFT one can recover a periodic discrete-time signal /[/;] 
from its spectrum F\k\. 

m = I £ F[k\e 2jlink / N . 

N k=0 

When deriving the inverse DFT, an important role is played by the fundamental 
property 

W k =0 

The DFT has similar properties to the Fourier transform of continuous-time sig¬ 
nals. An overview of these properties can be found in table 12 at the back of this 
book. Another similarity with the Fourier theory of continuous-time signals is the 
convolution product, which is called cyclical convolution in the case of periodic 
discrete-time signals, and which is defined by 

At—1 

(/ * g)M = J2 /[%[» - n- 
1=0 

The corresponding convolution theorem (the cyclical convolution theorem in the 
n -domain) states that the DFT of the cyclical convolution product is equal to the 
ordinary product of the DFTs of f[n] and g[n]. Apart from a convolution theorem 
in the n -domain, there is also a cyclical convolution theorem in the k-domain, which 
states that the DFT transforms the ordinary product f[n\g[n\ in the 77 -domain into 
the cyclical convolution in the k-domain, up to a factor 1/N. 

Finally, one can also formulate the following Parseval identity for periodic 
discrete-time signals: 

N -1 j N-l 

J2 fWgW = T7 E 

77=0 N k=0 

where F[k\ and G[k] are the DFTs of, respectively, /[/i] and g[n\. From this identity 
one can then obtain the power of a periodic discrete-time signal in the F-domain. 
One has the following result: 

N-l , N-l 

£i/mi 2 = -£ifmi 2 . 

77=0 k=0 


SELFTEST 

For a periodic continuous-time signal /(f) with period T and fundamental fre¬ 
quency coo, the Fourier coefficients are given by c _2 = ci = 1, c_ 1 = c\ = 2, 
cq = 1. The other Fourier coefficients are equal to zero. Let g[n] be the periodic 
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16.19 


16.20 


discrete-time signal with period 5 such that g[—2] — c _ 2 - g[— 1] = c_j, g[0] = cq, 
g[l] = ci,g[2] = c 2 . 

a Calculate the 5-point DFT G[k\ of g[n], 
b Show that f(2nm/5coQ ) = G[—m] for m e Z. 
c Prove that 

1 pT 1 I 4 

- \f(t)\ 2 dt= -VlGWI 2 . 

T Jo 5 k=i j 

The periodic discrete-time signals /[/;] and g[n] with period iV are given, for all 
integer n, by 

/[«] = + 1] - %[«] + S N [n - 1], 

g[n] = cos(47r;t/TV). 

a Determine the IV-point DFT of f[n], 

b Calculate the cyclical convolution product of /[/?] and g[n]. 
c Calculate the power of g[/;]. 

Given is a periodic discrete-time signal /[«] with period T. This discrete-time 
signal is a sampling of the periodic continuous-time signal /(f) with period T. The 
sampling period is equal to T /5. The signal /(f) is even and real. Let F[k\ be the 
5-point DFT of /[«]. 
a Show that F[k ] is also even and real. 

b It is given that F[0] = 1, F[l] = 2, F[2] = 1. Determine f\n] for all integer n. 
c Let furthermore be given that /(f) is band-limited, with bandwidth 10? x/T. For 
which values of k do we have = F[fc]/5? Here the numbers c\ are the Fourier 
coefficients of /(f). Justify your answer. 
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CHAPTER 17 


The Fast Fourier Transform 


INTRODUCTION 


The A-point discrete Fourier transform (DFT) was defined in chapter 16 as a trans¬ 
formation converting a periodic discrete-time signal f[n] in the n -domain into a 
periodic discrete signal F[k\ in the ^-domain according to the relation 

N- 1 

F[k] = J2 f[n\e~ 2llink/N 
n= 0 

= /[0] + f[l]e~ 27Tik / N + • • • + /[A - \] e -2x’k(N-l)/N 

If we now want to compute F\k] for a certain value of k, then in general one will 
need A — 1 (complex) multiplications and A — 1 (complex) additions to do so. If we 
call a multiplication or an addition in the complex plane an elementary operation, 
then in general we will thus need 2A — 2 elementary operations to compute F[k\ 
for any given k. If we want to determine F\k] for all k e {0, 1, .... A — 1), then 
in first instance we expect that this would require 2A 2 — 2A elementary operations. 
We then say that in a direct calculation of an (V-point DFT the number of elemen¬ 
tary operations is of order A 2 , for large A. In applications we will often have to 
compute DFTs based on a large number of points. This will then result in many 
elementary operations, and thus in a large number of round-off errors and a consid¬ 
erable computing time. Fortunately, one has come up with algorithms that reduce 
the number of elementary operations substantially. Most often, these algorithms are 
based on the factorization of A into prime numbers, and are known collectively as 
Fast Fourier Transform , abbreviated as FFT. In the most popular versions, A is a 
power of 2. 

If A can be written as a product of integers, say A = A 1 A 2 , then it will be 
derived in section 17.1 that the computation of the A-point DFT can be reduced to 
the computation of a number of N\ -point DFTs and A 2 -point DFTs. We get a much 
better overall picture of this reduction if we interpret the A 1 A 2 -point DFT as an 
operation on matrices. When Aj and Ni can be factorized as well, then we can 
again reduce the number of points in the DFTs to be calculated. In this way an FFT 
algorithm arises. A Fast Fourier Transform is thus not a transform, but in fact an 
efficient numerical implementation of the DFT. 

In section 17.2 special attention is paid to an FFT where A is a power of 2, so 
A = 2 m . An FFT algorithm then boils down to a repeated computation of 2-point 
DFTs. 

In the final section we will treat some applications of the FFT. These are, of 
course, applications of the DFT. We will examine the calculation of the spectrum 
of a continuous-time signal, the calculation of the cyclical convolution product, and 
the calculation of the so-called cross-correlation of two discrete-time signals. 
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LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know the relation between an IV-point DFT and the Ath roots of unity 

- can interpret an N\ AL-point DFT as an operation on matrices 

- can describe the importance and the advantage of an FFT 

- can give a global description of an FFT algorithm based on A = 2 m points 

- know the meaning of the term butterfly in an FFT algorithm 

- can describe how an FFT can be used to calculate the spectrum of a continuous¬ 
time signal 

- can indicate the advantage of the FFT for the calculation of a cyclical convolution 

- know the concepts of cross-correlation, autocorrelation and power spectrum 

- know the relationship between autocorrelation and power spectrum 

- can indicate the advantage of the FFT for the calculation of a cross-correlation or 
an autocorrelation. 


17.1 The DFT as an operation on matrices 


In this section we will examine how an A-point DFT, where A can be written as a 
product of positive integers (so A = Ai A 2 with N\ > 2, A 2 > 2), can be inter¬ 
preted as an operation on an Aj x A 2 -matrix. Such an interpretation is important in 
order to get a good grasp of an FFT algorithm. 

At the basis of an FFT algorithm lies the relationship between an A-point DFT 
and the so-called Ath roots of unity, which have already been introduced in chapter 
2 as the A distinct roots in the complex plane of the equation z N = 1. To begin 
with, we introduce the Ath root of unity wpj as follows: 


Wfj = e 


2-ni/N 


(17.1) 


In chapter 2 we have seen that the Ath roots of unity consist of integer powers of 
wjy. Since vvT,”^ = e ~2nink/N f or imeger n and k, it follows from definition 16.1 
that the DFT of a discrete-time signal /[n] can also be written as 


N -1 

F[k] = £ f[n]w~ nk . (17.2) 

n =0 

We can subsequently write this in a very compact way by introducing the following 
polynomials Pn(z)'- 


N— 1 


p N (z) = /[«]*"• 

n =0 


(17.3) 


From (17.2) it now immediately follows that 

F[k] = P N (w~ k ). (17.4) 

Computing an A-point DFT can apparently be viewed as the calculation of the values 
of a complex polynomial, where for z we take the Ath roots of unity. 

Let A = 3, /[0] = 1. /[ 1] = 0 and /[2] = 1. From (17.1) it follows that 
W 3 = e 2jn / 3 = (—1 4 - i a/3 )/2 and then the third roots of unity 1 , w^T 1 , vv ^" 2 
are given by 1, —(1 + /->/3)/2, —(1 — i\J 3)/2 respectively. Because of (17.3), the 


EXAMPLE 17.1 
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polynomial P 3 (z) has the form P 3 (z) = 1 + z 2 . Hence, it follows from (17.4) that 
F[0] = P 3 (l) = 2, 

F[ 1] = P 3 (—2(1 + iV 3)) = |(1 + (\/3), 

F[2] = P 3 (-±(l - (V 3)) = i(l - (\/3). 

◄ 

If N can be written as a product of two integers, so TV = N 1 N 2 with N\ and N 2 
integer and greater than or equal to 2, then there are simple relations between the 
roots of unity w^. , w v, and vvaj . Verify for yourself that the following relations 
hold: 

w^ 2 = w Nl and w^ l =w N2 . (17.5) 

One can use these relations cleverly in order to calculate the N\ A^-point DFT. To 
this end we assign in a unique way to each k e (0, 1, ..., N — 1} the integers p\ 
and p.2 according to 

k = [i\N 2 + M2 where 0 < P 2 < A^. (17.6) 

Hence, the number p j is the result of the so-called integer division (division with 
remainder) of k by 1V 3 , and /12 is the remainder in this division. In the same way we 
assign to each integer n e {0, 1, .. ., N — 1} the integers vj and v 3 according to 

n = i> 2 N[ + V| where 0 < rq < N\. (17.7) 

The numbers vj and rq thus arise from the integer division of n by N j. Since both 
k and n lie between 0 and N — 1, we have 

0 < p\, vj < N\ and 0 < po. v 2 < ^2- 

Now consider (17.2) for the At-point DFT and substitute here for k and n the expres¬ 
sions in, respectively, (17.6) and (17.7). First note that the sum X„X) a n is equal 
to the repeated sum X^ 1 —o' XE- 0 a v 2 N\+v\ ■ I n addition we will use relations 

(17.5) and the identity w^ lNl = w$ = 1. The calculation of the DFT then reads as 
follows: 

Ati-1 N 2 -l 

F[k] = F[p\N 2 + p 2 \ — E E /[vzAtj + v x ]w“ (wiV2+/i2)(V2Afl+Vl) 

vi =0 V2=0 

Ni-l N 2 -\ 

= E w~^ n w~' X2n J2 f[v 2 N l +v l ]w~^ 2V2 

171=0 V2=0 

iVi-1 

= E w n^ 2V1c ^ v i^7 

vi=0 

where 

JV 2 —1 

C[v 1 , M 2 ] = E f [V 2^1 + V ^ W N 2 2 " 2 - (17 - 8) 

V2=0 

We have now found that 
N\ — l 

F[p x N 2 + P2\= E w N IJ ’ 2Vlc t v l<P2>~ N i lVl - 

v\=0 


(17.9) 
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Twiddle factors 


At first, it may seem very complicated to calculate a DFT using (17.8) and (17.9). 
Still, it will be precisely these formulas that will give us a first clue how to determine 
a DFT efficiently. In order to get a good insight into the operations occurring in these 


formulas, we introduce a number of matrices consisting of N\ rows and N 2 columns 



/ m 

f[Ni] 

f[N-2N x ] f[N-Nii \ 




m 

/[iVt + 1] ... 

f[N — 2N\ + 1] flN-Ni + W 



= 







f[Ni - 2] 

/[2iVi-2] ... 

f[N - TV! - 2] f[N - 2] 




V/[Ai - 1] 

/[27V! - 1] ... 

f[N — TV j — 1] f[N — 1] / 






(17.10a) 


/ 

c[0, 0] 

c[0, 1] 

c[0, N 2 - 2] c[0, N 2 - 1] 

\ 



c[l,0] 

c[l, 1] 

c[l, N 2 — 2] c[l, TV 2 — 1] 


C = 







c[Ni - 2, 0] 

c[Ni-2, 1] ... 

c[TVi -2 ,N 2 - 2] c[Aj - 2, N 2 - 1] 1 


VcfAj - 1,0] 

c[7V! - 1,1] ... 

c[TVi - \ .N 2 - 2] c[N x - 1, TV 2 - 1] / 





(17.10b) 



( F[0] 

F[l] 

F[N 2 - 2] F[N 2 - 1] 

\ 



F[N 2 ] 

F[N 2 + 1] 

F[2N 2 - 2] F[2N 2 - 1] 


Mp 

= 







F[N - 2N 2 ] 

F[N -2N 2 + 1] 

... F[N — TV 2 — 2] F[N -N 2 - 

1] 



\ F[N — N 2 ] 

F[N - N 2 + 1] 

F[N - 2] F[A-1] 

/ 


(17.10c) 

The element My(/x, v) in row /x (/j. = 0, 1,..., N\ — 1) and column v (v = 
0, 1, .... N 2 — 1) is thus given by 


Mf(H,v) = f[vNi+nl (17.11) 

The element Mp(fi,v) in row /x (/x = 0, 1,..., N x — 1) and column v (v = 
0, 1,..., N 2 — 1) is given by 


v ) = F[ptN 2 + v]. 


(17.12) 


Having introduced these matrices, we return to (17.8) and (17.9). On the basis of 
(17.8) we note that for fixed vj the row c[vj, 0], ..., c\ v\, N 2 — 1] is the A^-point 
DFT of the row f[v x \, f[N\ + vj], .... /[( N 2 — I) AT] + uj]. For fixed /x 2 we can 
interpret (17.9) as the N x -point DFT of the column 

/ c[0, /x 2 ] \ 

w^ 2 c[l, fi 2 ] 

w -( Nl - 2 )fl2c[Ni _ 2j Mz] 

Vvv“ Wl “ 1),i2 c[)Vi - 1.M2]/ 

This is column i 2 of matrix C, however, with its elements multiplied by the factors 
w^ 11 . These factors are called twiddle factors. Formula (17.9) and the definition 
of the matrix Mp also show us that the N j -point DFT of this column can be found 
in column /x 2 of matrix Mp. 
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Algorithm for an N\ N 2 -point 
DFT 


EXAMPLE 17.2 


Summarizing, we have now derived a method for the calculation of the N\ Ap¬ 
point DFT of a discrete-time signal f[n], which consists of the following steps: 

- Construct the Ni x IVt matrix Mr from the discrete signal /[n|. 

- Calculate the Appoint DFT of row p (p = 0, 1, ..., N\ — 1) of matrix Mf and 
put this in row p of a new matrix C. 

- Multiply the elements of matrix C by the twiddle factors, that is to say, multiply 
c[p , v] by w N 11 ; call the new matrix Ct. 

- Calculate the N\ -point DFT of column v (u = 0, 1,..., IV 2 — 1) of matrix Ct 
and put this in column v of matrix Mp\ then finally matrix Mp represents the 
N\ Ns -point DFT of f[n]. 

As an illustration of this method we calculate the 6-point DFT of the discrete-time 
signal f[n] with /[0] = 1, /[ 1] = 1, /[2] = 0, /[3] = 0, /[4] = 1, /[5] = 1. We 
take N\ = 3 and N 2 — 2. The matrix Mr then looks as follows: 

//[0] /[3]\ /I On 

M f = /[ 1 ] m = 1 1 . 

\/[2] /[ 5]/ \0 1/ 

Next we have to take the 2-point DFT of the rows of this matrix. We are then dealing 
with the root of unity w 2 = —1 of z 2 = 1. Applying (17.4) in this situation is 
easy. For example, to calculate the 2-point DFT of the first row, we have to use the 
polynomial ? 2 (z) — /[0] + /[3]z. We subsequently substitute the values z = 1 
and z — — 1, resulting in the row (/[0] + /[3], /[0] — /[3]) as the 2-point DFT of 
the row (/[0], /[3]). Hence, determining a 2-point DFT is simply a calculation of 
the sum and the difference of the values of the signal. In this example the matrix C 
then looks as follows: 

/ c[0,0] c[0, 1] \ //[0] + /[3] /[0]-/[3]\ /I 1\ 

C = I c[l, 0] c[l, 1] = /[l] + /[4] /[l]-/[4] = 2 0 . 

V c[2, 0] c[2,1] / V/[2] + /[5] /[2] — /[5] / Vl -1/ 

We multiply the elements of this matrix by the twiddle factors. This means that the 
element in row p and column v is multiplied by h’ 6 ij1 . In the row with p = 0 and 
the column with v = 0 nothing changes, since w 6 ^ v = w® = 1 in these cases. 
In this example the element c[l, 1] also remains unchanged since it was already 
equal to 0. The element c[2, 1] is multiplied by Wg 21 = (e 2jr '^)~ 2 = e ~ 2n = 

- (1 + is/3)/2. The matrix Ct arising in this way looks as follows: 

( 1 1 

Ct = I 2 0 

VI j(l + is/3) 

We finally have to take the 3-point DFT of the columns of this matrix (as in example 
17.1). We then obtain the 6-point DFT in the following matrix: 

/ F[0] E[l]\ / 4 j(3 + t'x/3) 

F[2] F[3] = -i(l + ix/3) 0 

VF[4] F[ 5]/ V_i(l_tV3) i (3-/V3) 

Calculating the DFT using this method will only lead to an advantage for large 
values of N. We will verify this by calculating the number of elementary opera¬ 
tions. In doing so we will assume that the N\ -point DFT and the N 2 -point DFT are 
determined by a direct calculation. 
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Determining the matrix C means that we have to calculate a total of N\ DFTs 
based on M 2 points. For this we need 2M| (M 2 — M 2 ) elementary operations (see 
the introduction to this chapter). After this, the elements of C have to be multiplied 
by the twiddle factors. Since the twiddle factors are 1 for the first row and the first 
columns, we need another (Mj — 1 )(M 2 — 1) elementary operations to calculate the 
matrix Ct. Finally, to determine the matrix Mp we have to calculate M 2 DFTs based 
on N[ points. This requires yet another 2M2(M 2 — N\) elementary operations. We 
conclude that the described method requires a total of 

2M 1 M 2 (M 1 + N 2 ) - 3N 1 N 2 -N 1 -N 2 +l 

elementary operations. For large M this is of order JVj JV 2 (Mi + M 2 ). In the intro¬ 
duction to this chapter we have already noted that for large M a direct calculation of 
the IV-point DFT requires a number of elementary operations of the order IV 2 . With 
the method described above we thus benefit by a factor M 1 M 2 AM 1 + M 2 ). 

When, moreover, Mi or M 2 can be factorized even further, then we can again 
obtain a reduction when calculating the Mi-point DFT or the M 2 -point DFT. We will 
then benefit even more. 

We have already seen that the calculation of a 2-point DFT is extremely simple. 
Now if M is a power of 2, then the above implies that the M-point DFT can be 
calculated by a repeated application of 2-point DFTs. In the next section we will 
treat this case explicitly. 

EXERCISES 

17.1 Use (17.2) to show that the relation between f[n] and the 5-point DFT F\k] can be 

represented as follows (here w = e~ n *!‘)\ 


/! 

1 

1 

1 



// [0] \ 


(F[ 0]\ 

1 

w~ l 

w~ 2 

w~ 3 

w 4 


/[l] 


F[l] 

1 

w~ 2 

w~ 4 

tv -1 

w -3 


/[ 2] 

= 

F[ 2] 

1 

w~ 3 

w~ l 

w~ 4 

w~ 2 


/[ 3] 


F[3] 

Vi 

w~ 4 

H- 3 

w~ 2 

tv- 1 / 

V/[ 4]/ 

V F[4] / 


17.2 Determine the inverse of the matrix from exercise 17.1 by applying the inverse DFT. 

17.3 As in example 17.2, determine the 6-point DFT of the discrete signal given in exam¬ 
ple 17.2. However, now take N\ = 2 and M 2 = 3. 

17.4 Use a repeated 2-point DFT to calculate the 4-point DFT of the periodic discrete-time 
signal f[n] with period 4 given by /[—1] = 1, /[0] = 2, /[l] = 0, f[2\ — 2. 


Number of operations of 
Mi N 2 -point DFT 


17.2 The M-point DFT with M = 2 ,n 

In this section we pay special attention to the M-point DFT where M is a power of 2, 
so M = 2 m for some integer m > 1. In the previous section we discussed a method 
to reduce the calculation of an M-point DFT to a calculation of DFTs on a smaller 
number of points. We will study that method again for the special case M = 2 m . 
Put N] — 2 and M 2 = 2 m_1 . The 2 x 2 m ~ l matrix M f (see (17.10a)) then looks 
as follows: 

Mf =(K °] /[2] ••• flN ~ 2] 

f V/[l] /[3] /[M — 1] 

To each row of this matrix we first have to apply the M/2-point DFT in order to 
calculate the matrix C. This means that we have to calculate the M/2-point DFT of 
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Number of operations for 
2 m -point DFT 


Butterfly 


the discrete-time signals f[2n] and f[2n + 1], which are both periodic with period 
IV 2 = N/2. Let us assume that in the -domain this leads to the signals A[k ] and 
B[k\ respectively, so 

f[2n\ A[k] and f\2n + 1] B\k], (17.13) 


The matrix C then looks as follows: 

/A[0] A[l] ... A[v] ... A[iV 2 -l]\ 

” V e [°] ••• B M ••• B[N 2 -l])' 

The next step is to multiply the elements of this matrix by the twiddle factors. The 
element in row p and column v is multiplied by the twiddle factor WjJ xv . The first 
row (p — 0) and the first column (v = 0) do not change. Hence, the matrix Ct 
looks like this: 

Ct — ( A [0] A W ■■■ A M A[7V 2 - 1] \ 

\B[ 0] w~ l B[l] ... w~ v B [v] ... w- (N2 - l) B[N 2 -l]J' 

Finally, we have to determine the 2-point DFT of the columns of this matrix. We 
have already seen that the calculation of a 2-point DFT is nothing else but taking 
sums and differences. The 2-point DFT of column v of matrix Ct gives column v of 
matrix Mp , which finally gives us the (V-point DFT of the signal /[«]: 


/ F[0] F[l] ... F[v] ... F[N 2 — 1 ] \ 

\F[N 2 ] F[1V 2 + 1] ... F[JV 2 + u] ... F[N-l]J 


with 

/ F[v] \ 
\F[N 2 + V\J 


k A[v] + W ~ v B[v]\ 
\A[v]-w~ v B[v]J 


for v = 0, 1,... Al 2 — 1. (17.14) 


To determine A[k ] and B[k] we have to calculate the lV/2-point DFT of the signals 
f[2n] and / [2n + l] respectively. For this one can use the same method, by changing 
to N /4-point DFTs. One can repeat this process until only 2-point DFTs remain. 
This results in an FFT algorithm for which we now want to determine the number of 
elementary operations. 

Let <p(m) be the number of elementary operations necessary to calculate a 2 m - 
point DFT according to the method described above. For the calculation of A\k\ 
and B[k] one thus needs 2 <f>(m — 1) elementary operations. In order to determine 
F[k] from this, using (17.14), we see that two elementary operations are necessary 
to calculate F[0] and F[1V 2 ], and that three elementary operations are necessary 
to calculate F[v] and F[N 2 + v] for v = 1 , 2 ,..., N 2 — 1 . This gives a total of 
2 + 3(N 2 — 1 ) = 3 • 2" !_l — 1 elementary operations. From this we obtain a 
recurrence relation for <f>(tn): 


tj>(m) = 2 (/>(m - 1) + 3 • 2 m ~ l - 1. 


Since the calculation of one 2-point DFT requires one addition and one subtraction, 
we know that 0(1) = 2. By induction one can then show that 

<j>(m) - (3 m - 2)2"'H? + 1. 


Hence, for the FFT executed in the way described earlier, the number of elementary 
operations is of order m ■ 2 m = N(~ log N). Compared to N~ this is a considerable 
reduction for large values of N. 

The calculation of F[v] and F[N 2 + v] from A[v] and B[v] according to (17.14) 
and using the twiddle factors w^ v is sometimes called a butterfly and can be repre¬ 
sented by the scheme in figure 17.1. This scheme should be interpreted as follows. 
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FIGURE 17.1 
An FFT butterfly. 


The term B[v ] is multiplied by w . Next, the sum and difference of A[v] and 
B[v]w^ v give, respectively, F[v] and FfAG + v]. One uses the term ‘butterfly’ 
because the scheme has the shape of a butterfly. An FFT algorithm for the calcu¬ 
lation of a 2 m -point DFT thus consists of a repeated application of butterflies. In 
figure 17.2 the butterfly-scheme is given for N = 8. In this scheme we recognize 


DFT 

{N= 2) combine combine 

< -► «-M-► 



The 8-point FFT butterfly. 


that one uses the first coefficients of the two 4-point DFTs to determine T[0] and 
F[4], To determine the latter two, we in turn use the first coefficients of the 2-point 
DFTs, etc. In figure 17.2 we see that at the start the sequence /[0], /[l], ..., /[7] is 
mixed up. If we represent the numbers 0, 1, ..., 7 as 3-digit binary numbers, then 
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Bit reversal 


changing the order from 0, 1, ..., 7 into 0, 4, 2, 6, 1,5, 3, 7 can be represented in 
the binary system as follows: 


decimal 

number 

binary 

representation 

bit reversal 

decimal 

representation 

0 

000 

000 

0 

1 

001 

100 

4 

2 

010 

010 

2 

3 

Oil 

110 

6 

4 

100 

001 

1 

5 

101 

101 

5 

6 

110 

Oil 

3 

7 

111 

111 

7 


Note how the new ordering arises by reversing the bitrow in the binary representa¬ 
tion. We call this bit reversal. One can show for general N — 2 m that the start¬ 
ing sequence of the butterfly scheme can be obtained by representing the numbers 
0, 1, ..., N — 1 as binary numbers with m digits and then applying bit reversal. We 
will not go into this any further. 

EXERCISES 

17.5 Give the butterfly scheme for the calculation of a 4-point DFT and use this to de¬ 
termine the 4-point DFT of the periodic discrete-time signal with period 4 given by 
/[—l] — 2, /[0] = i, /[l] = 1, f[2] = i. 

17.6 Given is a periodic discrete-time signal /[/?] with period N and f[2n + 1] = 1 
for all integer n. Moreover, the A/2-point DFT A[k] of the signal /[2n] is given. 
Calculate the A-point DFT of /[«]. 

17.7 Given is a periodic discrete-time signal f\n] with period 41V. For the signals /[4n], 
f[4n + 1], f[4n + 2], f[4n + 3] the IV-point DFTs are given by, respectively, A[k \, 
B[k\, C[A'], D[k\. Calculate the 4IV-point DFT of f[n\. 


17.3 Applications 

In the introduction we have already noted that an application of the FFT is in fact 
an application of the DFT. In chapter 16 we have seen an application of the DFT, 
namely, the calculation of Fourier coefficients. Applying the DFT is now becoming 
much more attractive since we have fast algorithms available to compute it. For this 
we prefer DFTs where the number of points is a power of 2. This implies that for the 
calculation of the Fourier coefficients of a periodic signal f{t) with period T, the 
number of samples in [0, T) should also be a power of 2. 

Apart from this, it is quite natural to look at possible applications of the DFT to the 
calculation of the Fourier integral, or the spectrum, of a non-periodic continuous¬ 
time signal. 


17.3.1 Calculation of Fourier integrals 

The Fourier transform or spectrum F{a>) of a continuous-time signal f(t), or, put 
differently, of a function defined on R, has been defined in chapter 6 as the improper 
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Time window 


Riemann integral 


F(co) = 


i: 


f (t)e 


dt. 


In order to calculate this integral, we are first of all confronted with the problem 
of improper integration, in this case integration over R. If the signal is absolutely 
integrable, then 


r T 


[ f(t)e- i0Jt dt 

F(a>) — / / {t)e~ l<ot dt 

= 

J-T 


J\t\>T 


L 


| fit) | dt —»■ 0 for T —»■ oo. 


>\t\>T 

Hence, for sufficiently large T and arbitrary a>, the integral 


(17.15) 


c 


F T {at) = / f {t)e~' wt dt 


(17.16) 


will be a good approximation of F(a>). We can also write (17.16) in the form 


c 


f(t)e~“°’ dt = 


/: 


f(t)P2T(t)e l< °’ dt. 


The integral in (17.16) represents the spectrum of /(t)P2r(0, where pirii) is the 
rectangular pulse function with duration 2 T (see (6.10)). We now say that f(t) is 
multiplied by a rectangular time window with width 2 T. In the frequency domain 
this corresponds to a convolution of F(a>) with 

2 sin Ten 
a> 

Multiplication by a time window introduces a first error when we determine the 
spectrum F(co) in this way. By (17.15), this error is small if the time window is 
chosen sufficiently wide. 

Next we want to calculate the integral in (17.16), after a suitable choice of T , 
using a sampling of f(t) with 2N samples in the interval [— T, T\. The sampling 
period is thus equal to T/N. We put t„ = nT/N. Applying the trapezoidal rule (see 
section 16.1) to the integral in (17.16) leads to 


Fj f to) 


T 

2N 


N -1 

f(-T)e icoT + f(T)e~ i0)T + 2 £ f(t n )e~ ia 

71=1 —At 


(17.17) 


In order to use the DFT based on 2 N points, we now define a periodic discrete-time 
signal fp[n] with period 2N as follows: 


fp[-m= Uf(-T) +f(T)), 

f p [n] = f(t n ) for n = -N + 1, -N + 2,..., N - 1. 
Substitution of to = kn/T in (17.17) gives 


(17.18) 



- I I] f P ln\e~ 2 ” ikn ' 2N . 
n=—N 


(17.19) 


Up to the factor T/N, the right-hand side equals the 21V-point DFT of f p [n |; see 
definition 16.1. Since Fpico) is an approximation of the spectrum F(to), (17.19) 
shows us how a DFT can be used to approximate the spectrum of a non-periodic 
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EXAMPLE 17.3 


continuous-time signal. However, as in the case of the Fourier coefficients, this will 
not result in a reliable approximation for all k. In general one will get good results 
for | k \ < N/2, with an error of the order of ( T /AO 2 . We will not go into this 
any further. We do, however, want to make the following remark. The choice of 
the width IT of the time window apparently results in a distance n/T between two 
consecutive frequencies for which the spectrum is being determined. The number 
of frequencies for which the spectrum can be determined with a specific degree of 
accuracy is thus related to the number of samples in the chosen time window. 

As an example of the use of a DFT to approximate the spectrum of a continuous-time 
signal, we consider the causal signal f(t) given by fit) = e~ 2, e(t). The spectrum 
Flo) of this signal is known (see table 3): 


F(o) = 


1 

2 + iu> 


We choose a time window with width 2 T = 10. This introduces a first error in the 
calculation of the spectrum, which can easily be estimated as follows: 


| F(o) - F 5 (o) | < f | fit) \dt = f e~ 2 ' dt « 2.3 ■ 10 -5 . 

J\t |>5 J 5 

Next we determine the discrete-time signal f p [n] according to (17.18). Special 
attention has to be paid to the discontinuity of fit) at t = 0. For f p [ 0] we have to 
choose (see section 16.1.2): f p \ 0] = j(/(()+) + /(0—)) = j. We take N = 128 
and determine the 2,/V-point DFT of the signal f p [n]. Multiplying this DFT by T/N 
then gives an approximation of the spectrum at the frequencies kn/T. In table 17.1 
these approximations are given, together with the exact values accurate to 4 decimal 
digits. 


TABLE 17.1 Approximation using a 256-point DFT and the exact values of the 
spectrum of a non-periodic signal. 


k 

approximation 

exact 


00 

0.5002 


0.5000 


01 

0.4554 - 

0.14291 

0.4551 

-0.14301 

02 

0.3587 - 

0.22521 

0.3585 

-0.22511 

03 

0.2651 - 

0.24931 

0.2648 

- 0.24961 


63 

0.0016 

- 0.02001 

0.0013 - 

0.02521 

64 

0.0015 

- 0.01951 

0.0012- 

0.02481 

65 

0.0015 

- 0.01951 

0.0012- 

0.02441 


126 

0.0008 

- 0.00021 

0.0003 

- 0.01261 

127 

0.0008 

- 0.00051 

0.0003 

-0.01251 

128 

0.0008 

- 0.00071 

0.0003 

- 0.01241 


It is useless to tabulate F[k] for k > 128. The signal /(f) is real, so F[/r] = 
F[—k\ = _F[256 — k]. As far as the quality of the approximation is concerned, we 
note that the approximation is only satisfactory for relatively small values of k. In 
practice this is usually sufficient. ^ 
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The signal /(f) in example 17.3 is causal since /(f) = 0 for f < 0. Hence, 


Fj (o>) = 


-L 


me- 


=L 


dt = I f(t)e w dt. 

o 


Applying the trapezoidal rule to the integral in the right-hand side and substituting 
co = 2kn/T gives 


Fj 


/,0+) + / (r -) + tg f(ln)e -2 MIN 


\T A 


\ 


n= 1 


(17.20) 


From this we conclude that the spectrum at 2kn /T can be calculated with an Ap¬ 
point DFT. However, the values thus calculated correspond exactly with the values 
calculated with the 2fV-point DFT using (17.19) with k replaced by 2k: 


Ft (tO * l E fpWe- 27tikn/N 

^ ' n=—N 

= jf + E fp^ e ~ 2niknlN ^j ■ 

Now according to (17.18) we have f p [-N] = f{T)/2 and f p [ 0] = /(0+)/2 
(since f p [0 ] = (/(0+) + /(0—))/2 and / is causal) and if we substitute this in the 
preceding formula, then we obtain precisely (17.20). 

In this section we used the DFT to calculate the spectrum of a signal /(f), af¬ 
ter applying a time window, for a number of specific frequencies. By utilizing an 
FFT algorithm to compute the DFT, a spectrum can thus be approximated quite effi¬ 
ciently. 


17.3.2 Fast convolution 

According to definition 16.2, the cyclical convolution product of two periodic discrete¬ 
time signals f\n] and g[n] with period A is given by 

N -1 

(/ * g)[n] = ^2 fU]g[n ~ l] for n e Z. 

1=0 

In order to calculate the convolution product for a specific value of n, it seems 
that we have to perform N — 1 additions and N multiplications; that is, 2 N — 1 
elementary operations in total. A straightforward calculation of the convolution 
product for n = 0, 1, ..., N — 1 would then require 2 N~ — N elementary operations. 
For large N the number of operations is thus of the order N~. Again, this number 
of elementary operations can be reduced considerably by using an FFT algorithm. 
Here the convolution theorem plays an important role. First we calculate the Ap¬ 
point DFT of f[n] and g[n]. Let us denote these by F[fc] and G[k\ respectively. By 
the convolution theorem 16.2, the A-point DFT of the convolution product is simply 
the product of F[k\ and G[k ]. By an inverse DFT of F\k]G[k] to the n -domain, 
we obtain the convolution product. Calculating the convolution product in this way 
requires fewer elementary operations than the direct method. For if we assume 
that the calculation of an A-point DFT using an FFT algorithm requires A( 2 log A) 
elementary operations, then the total number of elementary operations to calculate 
the convolution product equals 2A( 2 log A) + A + A( 2 log A) = 3A( 2 log A) + A. 
Here we assumed that the inverse DFT is also calculated using an FFT algorithm. 
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Fast convolution 


DEFINITION 17.1 

Cross-correlation 


Autocorrelation 


Power spectrum 


Compared to the number of the order N 2 , this is still a considerable reduction for 
large values of N. Calculating a convolution product using the FFT is also called 
fast convolution. 


17.3.3 Fast correlation 

An operation on signals that is related to convolution is the so-called cross-correlation. 

The cross-correlation of two periodic discrete-time signals /i[«] and fjin] with 
period N is defined by 

N 1 

Pl,2[«] = J2 7lPl/2[» + H (17.21) 

1=0 

Contrary to the convolution product, the cross-correlation is not commutative (verify 
this yourself). 

For the calculation of the cross-correlation p\ 2 ln] we will again use the DFT. Let 
f\[n\ F\[k] and /jfw] 4> //[Tf According to the shift property we then have 

f 2 [n +/]■«• e 2yT,lk / N F 2 [k\. Next we use the linearity of the DFT to obtain that 

N- l 

Pl, 2 W J2 7iU]e 2nilk/N F 2 [k] = TMF 2 [kl (17.22) 

1=0 

In order to calculate pi 2 [«] in practice for large values of N, we see that, just as 
for the convolution, transforming it to the fc-domain can result in a considerable 
advantage. Check for yourself that the number of elementary operations needed for 
the calculation of the cross-correlation by means of an FFT algorithm is equal to the 
number of elementary operations needed for the calculation of the fast convolution. 

When f\[n] = / 2 M = f[n] in formula (17.21), then we call pj^tn] the 
autocorrelation of the signal f[n\. From (17.22) it follows that the (V-point DFT 
of the autocorrelation is given by 

PM 4 * FWWlk] = | F[k] | 2 . 

The spectrum of the autocorrelation is called the power spectrum of the periodic 
discrete-time signal f[n]. 

EXERCISES 

17.8 Given is the causal continuous-time signal /(f) = e~ 2, e(f). In example 17.3 we 
used a 2(V-point DFT to approximate the spectrum at the frequencies kn/T. After¬ 
wards we noted that the spectrum at the frequencies 2 kn/T could be approximated 
using an (V-point DFT. Find out whether the spectrum at the frequencies (2k + 1)jt/T 
can also be approximated using an (V-point DFT. 

17.9 Given is a continuous-time signal /(f) with the properties: /(f) = 0 for | f | > T for 
some T > 0, /(f) is continuous and odd. For /(f) a sampling f[n] is available with 
sampling period T/N. Give an efficient way to approximate the spectrum of /(f), 
assuming that you can use efficient algorithms to calculate DFTs with an arbitrary 
number of points. 


17.10 


Calculate the autocorrelation of the periodic discrete-time signal with period N 
given by /[«] = cos(2nn/N), and use this to determine the power spectrum 
of /[«]. 
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17.11 

17.12 


17.13 

17.14 

17.15 

17.16 


Calculate the cross-correlation pj 7 of f\[n] = 5^[/;] + <5^[r; — 1] and fi[n} = 
5At [h] + <5 at [n + 1 ] using the DFT. 

Let the two sequences of complex numbers a\ , 02, ..., Off and b\,bi, ■ ■ ■ ,b]g be 
given. Indicate how the sum a nbn can be calculated using the DFT. 


SUMMARY 

An A-point DFT can be computed efficiently if we use a factorization of A into 
integers. Calculating an N\Ni -point DFT is then reduced to a calculation of Ap¬ 
point and A 2 -point DFTs. This can be accomplished using properties of the Ath 
roots of unity = e^ ni ' N . This is because a DFT can be interpreted as the 
determination of a complex polynomial at the Ath roots of unity. The reduction 
method of an Aj A 2 -point DFT to N\ -point and A 2 -point DFTs can be represented 
in a convenient way by considering the AjA 2 -point DFT as a matrix calculation 
together with a multiplication by certain factors, called twiddle factors. 

Efficient algorithms for the calculation of the DFT are collectively known as Fast 
Fourier Transform, abbreviated as FFT. Popular versions have the number of points 
in the corresponding DFT equal to a power of 2. In this situation the algorithm is 
based on a repeated application of 2-point DFTs. In comparison to a direct calcu¬ 
lation of an A-point DFT, which requires a number of complex multiplications and 
additions of the order A 2 , an FFT algorithm with A = 2'” requires a number of 
multiplications and additions of the order A( 2 log A). This is a considerable reduc¬ 
tion. 

Applications of the FFT are in fact applications of the DFT. The Fast Fourier 
Transform is used, for example, to calculate Fourier coefficients and Fourier inte¬ 
grals. Using the convolution theorem, one can also calculate the cyclical convolution 
product efficiently, for large values of A, by means of the FFT. Closely related to 
the cyclical convolution product is the cross-correlation of two periodic discrete¬ 
time signals. There is a simple expression of the DFT of a cross-correlation as a 
product of the DFTs of the signals involved (only a conjugation enters). As a con¬ 
sequence, one can also calculate a cross-correlation efficiently using an FFT. The 
cross-correlation of a signal with itself gives the autocorrelation. The autocorrela¬ 
tion has the special property that its DFT equals the power spectrum of the signal. 


SELFTEST 

Given is a periodic discrete-time signal f\n ] with period 3. Let w — \ (— 1 — iy/3). 
Show that the three-point DFT F[k] of /[/?] is given by F[k] — /[0] + w k (f[ 1 ] + 
w k f[ 2 ]). 

Given is a periodic discrete-time signal f[n] with period 3A. The A-point DFTs of 
the signals /[3n], f[3n + 1], f[3n + 2] are given by A[k], B[kf C[k\ respectively. 
Calculate the 3A-point DFT of f[n]. 

Describe a method to calculate an A-point DFT efficiently for A = 3'”. 

Given are the causal discrete-time signals /[ n ] and g[n] with f[n] = 0 and g [ n ] = 
0 for n > A and some A > 0. Indicate how one can use the DFT to calculate the 
sums 
N 

J2 /[%[«- 'i 

/=0 
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for integer n. Is it useful, as far as the number of additions and multiplications is 
concerned, to use the FFT? Justify your answer. 

17.17 Given is a periodic discrete-time signal f\n\ with period 4. Moreover, the signal is 

even and real. Show that for the 4-point DFT one has 

F[0] = /[0] + 2/[l] + /[2], 

F[l] = /[0] - /[2], 

F[ 2] = /[0]-2/[l] + /[2], 

F[ 3] = F[l]. 
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CHAPTER 18 


The z-transform 


INTRODUCTION 


The discrete Fourier transform, in the first instance intended for periodic discrete¬ 
time signals, arose in chapter 16 in a natural way in the context of the calculation 
of the Fourier coefficients of periodic signals. Calculating the spectrum of a non¬ 
periodic signal introduces in a similar way a Fourier transform that can be applied 
to non-periodic discrete-time signals. This transform can also be considered as a 
special version of the so-called z-transform, which will be studied first in the present 
chapter. 

The z-transform assigns a function F(z) to a discrete signal f\n \ and is defined 
in the complex z-plane as the sum of the ‘two-sided’ series 

oo 

F(z)= J2 /M* - "- 

TI — —00 

The z-transform plays an important role in the analysis of discrete systems, which 
will be examined in the next chapter. 

The treatment of the z-transform will follow the same path as the treatment of any 
of the other transforms in this book. First we present the definition, with appropriate 
attention being given to convergence problems (section 18.1). We subsequently 
establish a number of important properties (section 18.2). 

However, there is also a difference. We will not formulate a fundamental theorem 
for the z-transform. The reason is that for a proper treatment of such a theorem, 
showing how a signal can be recovered from its z-transform, we would have to use 
some advanced theorems from the theory of integration of functions dehned in the 
complex plane. This theory is outside the scope of this book. Reconstructing a 
signal from a given z-transform will therefore almost always be limited to situations 
frequently occurring in practice, which means that the z-transform is given as a 
rational function of z. In section 18.3 we will see how the technique of the partial 
fraction expansion can lead us to the original signal then. 

As for almost every other signal-transform, the z-transform gives rise to the defi¬ 
nition of a convolution product in the n -domain, and also to a corresponding convo¬ 
lution theorem. This is the subject of section 18.4. We will not formulate a Parseval 
theorem for the z-transform. In relation to the z-transform it is less appropriate and 
it is better suited for the Fourier transform of discrete signals. 

Finally, in section 18.5, the Fourier transform of non-periodic discrete-time sig¬ 
nals is treated. This arises from the z-transform by substituting the value e ,a> for z. 
The variable co can then be interpreted as a frequency. Treating this transform, we 
will see that we can use the theory of the Fourier series to our advantage. 
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DEFINITION 18.1 

Z-transform 


LEARNING OBIECTIVES 

After studying this chapter it is expected that you 

- know the definition of the z-transform and can indicate the region of convergence 

- can readily apply some of the most frequently occurring properties of the z- 
transform 

- can calculate the z-transform of some elementary signals 

- know the definition of the convolution product for the z-transform and can formu¬ 
late the corresponding convolution theorem 

- know the definition of an absolutely summable signal and of a signal with a finite 
switch-on time 

- can determine an absolutely summable discrete-time signal, or a signal with a 
finite switch-on time, whose z-transform is a given rational function 

- know the definition of the Fourier transform of discrete-time signals 

- can relate the Fourier transform to the z-transform and to Fourier series 

- can derive the most frequently occurring properties of the Fourier transform from 
the theory of the Fourier series, and can apply these 

- know Parseval’s theorem for the Fourier transform and can apply it to the energy- 
content of a discrete-time signal. 


18.1 Definition and convergence of the z-transform 

In chapter 16 a Fourier transform has been introduced for periodic discrete-time 
signals, the so-called discrete Fourier transform, abbreviated as DFT. In this chap¬ 
ter we consider discrete-time signals f[n\ that are non-periodic. A transformation 
having some similarity with the DFT is the discrete transform which assigns to the 
non-periodic signal f [n ] the Fourier series 

oo 

E f[n]e~ in(0 forsiel. 

n=—o o 

The foundation of this transform is the so-called z-transform, which will be treated 
first. Specifically, if we substitute z = e ,tu in the Fourier series above, then we 
obtain the series 

oo 

E /[«]*■"’ 

n—— oo 

which can then be considered for general complex z. In definition 18.1 the sum 
of this series will be called the z-transform of /[«]. Of course, this series is only 
meaningful for those values of z for which the series converges. 

Let f[n] be a discrete-time signal. The z-transform of f[n] is defined by 

oo 

F(z) = E fMz~ n , (18.1) 

n=—o o 

for those values of z for which the series converges. 

We note that the z-transform can be considered as some sort of two-sided power 
series, having not only positive integer powers of z. but also negative integer powers 
of z. For such series one has similar convergence properties as for power series. 
In order to find these properties, we will split the z-transform into two parts, the 
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Causal part 


Anti-causal part 


so-called causal part given by the series 

oo 

X)/[n]z _ ", (18.2) 

n =0 

and the anti-causal part given by the series 
-1 

E fWz~ n . (18.3) 

n= —oo 

Note that the anti-causal part can be rewritten as 

— 1 oo 

E mz~ n = ^f[-n]zT, 

n=-oo n=l 

which transforms it into a power series in z with coefficients /[—«]. 

Convergence of the z-transform means that the series 

N 

E fW z ~ n 

n=—M 

should converge for M oo and N —> oo, independently from each other. Conse¬ 
quently, the z-transform converges if and only if both the causal and the anti-causal 
part converge. We denote the sum of the causal part by F+ (z) and the sum of the 
anti-causal part by F_(z). Hence, in the case of convergence we have 

oo 

F+(z) = E/[«]z _ ". 

n =0 
-1 

F-(z) = E /Wz“". (18.4) 

n= —oo 
oo 

F(z)= E fM z ~ n = F-(z) +F+(z). 

fl=—0 o 

It is thus important to find out for which values of z both parts converge. The 
anti-causal part is a power series in z. If we put w — 1/z, then we see that the 
causal part is a power series in w. Complex power series have a radius 

of convergence R (see chapter 2) for which we have one of the following three 
possibilities: 

a when R = 0. the power series converges only for z = 0; 
b when R = oo, the power series converges absolutely for all complex z; 
c when R > 0, the power series converges absolutely for | z I < R and diverges 
for | z | > R. 

Now let Rj be the radius of convergence of the anti-causal part and Uj -1 the radius of 
convergence of the power series YUnLo /[«]w n . Then the anti-causal part converges 
absolutely for | z | < R 2 and the causal part converges for | z | > R 1. 

- If Ri < R 2 , then we may conclude that the z-transform converges in the ring 
Ri < Izl < R 2 (see figure 18.1). For \z I > R 2 the causal part converges while 
the anti-causal part diverges, and so the z-transform is divergent. For | z | < R\ 
the anti-causal part converges while the causal part diverges, and so again the 
z-transform is divergent. We will call the ring R\ < \ z I < R 2 the region of 
convergence of the z-transform. The region of convergence does not necessarily 


Region of convergence 
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Signals with a finite 
switch-on time 



FIGURE 18.1 

Region of convergence of the z-transform. 


coincide with the set of all z for which the z-transform converges. Specifically, 
the z-transform may well be convergent at some of the points on the boundary of 
the ring. We will not go into this any further. 

- If R\ > R 2 > then the z-transform diverges for every complex z and so the region 
of convergence is empty. 

- If R[ =0 (which means that the causal part converges for every z 7 ^ 0), then 
the region of convergence is the interior of the circle with radius R 2 , with the 
exception of z = 0. If all terms of the causal part are zero, with the possible 
exception of the term with n = 0 , then z = 0 also belongs to the region of 
convergence. 

- If /?2 = 00, then the region of convergence is the exterior of the circle with radius 

Al¬ 
in practice we are usually dealing with signals that have been switched on at a 
certain moment in time. Such signals will be called signals with a finite switch-on 
time. For these signals there exists an N such that /[n] = 0 for all n < N. The 
anti-causal part then consists of only a finite number of non-zero terms and so this 
part converges for all z, implying R 2 — 00 ■ The region of convergence is then the 
exterior of a circle with radius R[ (see figure 18.2). Examples of this are of course 
the causal signals. The mapping assigning the z-transform F(z) to /[;?] is called 



FIGURE 18.2 

Region of convergence of a signal with a finite switch-on time. 
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z-transform 
Transform pair 


z-domain 


EXAMPLE 18.1 


EXAMPLE 18.2 


EXAMPLE 18.3 


the z-transform , and when V is the region of convergence, then we denote this by 
the transform pair 


/[;;] F(z) for z € V. 


We will also call F(z.) the description of the signal f[n] in the so-called z-domain. 
The z-domain is the complex plane. 

Let f\n] be the signal given by 

I I /n for n > 0, 

0 for n = 0, 

2" for n < 0. 

The anti-causal part is the power series 



This is a geometric series which is convergent for | z 
The causal part is the series 


oo —n 

o+V — 

n =1 ” 


E 

n= 1 


< 2 and divergent for | z I > 2. 


This series can be considered as a power series in 1 /z, which converges for | 1/z | < 
1 (see chapter 2). Hence, the causal part converges for | z\ > 1 and diverges for 
| z I < 1. The region of convergence of the z-transform of the signal /[»] is thus the 
ring 1 < | z | < 2. M 


Let f[n] be the causal signal given by f\n\ = a n e[n], where a e C/ 0. Since 
/[/;] = 0 for n < 0, all terms of the anti-causal part of the z-transform are zero, and 
so this part converges for every complex z. Hence, — 00 ■ The causal part is a 
geometric series: 



This geometric series converges for | z | > | a |. The region of convergence is thus 
the exterior of the circle in the complex plane with radius | a |. The sum of the 
geometric series is equal to z/(z — a). We have now found that 

a"e[?i] 4*—-— for | z | > |a |. (18.5) 

z- a 


Let f\n] be the discrete-time signal defined by 


f[n\ = 


0 for n > 0, 

—a" for n < 0. 


Here a e C, a 0. All the terms in the causal part of the z-transform are zero, and 
so the causal part converges for every complex z and has sum 0. The anti-causal 
part is found as follows: 


E (-a n z~‘ 


OO 

> = -£© 


n= 1 


n 
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EXAMPLE 18.4 


Linearity 


Again this is a geometric series with ratio z/a, convergent for | z \ < \ a \ and with 
sum z/(z — a). The region of convergence is thus the interior of the circle in the 
complex plane with radius | a [. We have now found that 

f[n] ** —for | z | < \a\. 
z — a 

The z-transform of the discrete unit pulse 5[/?] is easy to calculate. A direct substi¬ 
tution gives 

oo 

J2 S[n]z~ n = 1, 

n=—o o 

and this series converges for every complex z. We thus have 

8[n] 4*1 for all z e C. (18.6) 

Apparently, the region of convergence is the whole complex plane. ^ 

Examples 18.2 and 18.3 illustrate how important it is to indicate the region of 
convergence of the z-transform. We see that in both of the examples the z-transform 
equals z/(z — a), while the signals f\n] are different. Fortunately, the regions of 
convergence also differ. 

From the above it should be clear that / [ n ] is not uniquely determined when only 
F(z) is given. In order to determine /[/;] uniquely one must also know the region of 
convergence. Determining an inverse z-transform thus requires us to be very careful, 
and in addition one will also need a mathematical tool that is outside the scope of 
this book. However, we have seen that for signals with a finite switch-on time, such 
as causal signals, the region of convergence is the exterior of a circle. In that case 
we can recover the signal f[n\ from the sum F(z) only. We will return to this in 
section 18.3. 

EXERCISES 

18.1 Determine the region of convergence of the z-transform of a discrete-time signal 
f[n] having only finitely many values f[n] unequal to zero. 

18.2 Sketch the region of convergence of the z-transform of the signal f[n] given by 
f[n] = (2"» + 3-")6[n]. 

18.3 Sketch the region of convergence of the z-transform of the following signals: 
a f[n] = ( 2 n + 3”)e[—n], 

b f[ri\ = cos(;i7r/2)e[n], 
c f[n] = cos(;i7r/2)e[n] + (2" + 3”)e[—«]. 

18.2 Properties of the z-transform 

The properties or rules that are treated here will use the transform pairs f[n] 4* 
F(z) and g[n] 4* G(z). An overview of the properties can be found in table 14 at 
the back of this book. 

18.2.1 Linearity 

From definition 18.1 it follows immediately that the z-transform is a linear transfor¬ 
mation. This means that for all complex a and b we have 


af[n] + bg[n] 4 * aF{z ) + bG{z). 


( 18 . 7 ) 
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Time reversal 


Conjugation 


Shift in the n -domain 


18.2.2 Time reversal 

By time reversal we mean the operation in the n -domain whereby n is replaced by 
—n. This has the following consequence for the z-transform: 

/[-«] F (*) . (18.8) 

Prove this property yourself. 

18.2.3 Conjugation 

The z-transform of /[n] can be found using the following direct calculation: 

oo oo 

J2 7Mr" = J2 /[«]©“" = TO- 

n=—o o n=—oo 

This implies the conjugation property 

W\ TO- (18.9) 

If the signal f[n] is real, so f[n] = f[n], then it follows from (18.9) that F(z) — 
F(z). Conversely, if F(z) = F(z), then we can show that the signal f\n] has to be 
real. 

If / [n | is a real signal and a is a zero of F(z), then ci is also a zero of F(z). This 
follows from F(a) = F(a) = 0, so F(a) = 0. Hence, the zeros lie symmetrically 
with respect to the real axis (see figure 18.3). 


Im z 


* 


* 


-K- 


* 


0 


*-► 

Re z 


* 


FIGURE 18.3 

Zeros of the z-transform of a real signal. 


18.2.4 Shift in the n-domain 

In section 16.3.5 it was already noted that shifting in the n-domain is only allowed 
for an integer /. The corresponding operation in the z-domain can be derived as 
follows: 

oo oo 

J2 f[n-l]z~ n = J2 /["k“ ( " +,) = Z~ 1 F(Z). 
n=—o o n——o o 

From this we obtain the shift property of the z-transform: 
f[n - l] Z ~‘ F(z). 


(18.10) 
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EXAMPLE 18.5 


Scaling in the z-domain 


Differentiation in the 
z-domain 


Using the discrete unit pulse, we can describe a discrete-time signal /[«] having 
/[«] f 0 for only finitely many values of n by the finite sum 

N 

/[«]= E nmn-i\. 

1——N 

Here N is chosen such that /[«] = 0 for | n | > N. Since <5[/r] -o- 1, applying the 
shift property (18.10) and the linearity (18.7) gives 

N 

F(z)= J2 
l=—N 

What shows up here is nothing else but definition 18.1 of the z-transform of the 
given signal. ^ 


18.2.5 Scaling in the z-domain 

Instead of a shift in the z-domain, we now consider a scaling in the z-domain. This 
is because a shift in the z-domain will lead to a complicated and not very useful 
operation in the n -domain. 

Scaling in the z-domain means that we replace z by z/a, where a e C, a / 0. 
We have 

t /w©-- t 'mr- 

n=—o o n=—o o 

From this, the following rule for scaling in the z-domain immediately follows: 
a n f[n] -o- F (^) . (18.11) 


18.2.6 Differentiation in the z-domain 

Complex power series have similar properties to real power series. One of these 
concerns the termwise differentiation of a power series (see chapter 2). We for¬ 
mulate this as follows. When the complex power series YHnLo anZ " has ra( hus of 
convergence R and when S(z) is the sunt for | z | < R, then S(z) is differentiable for 
| z I < R (see chapter 11 for differentiability of complex functions) and, moreover, 

d 00 

— S(z) = na n z n ~ l for | z | < R. (18.12) 

dz , 

71=1 

We will not prove this property. This property can be extended in an obvious way 
to the two-sided power series Ylm=-oo a > i£ n that we encounter in the z-transform. 
Termwise differentiation is then allowed in the region of convergence, which is 
mostly a ring in the complex plane. Term-by-term differentiation gives 

, oo oo 

f[n]z~ n = - n/[n]z - " -1 . 

z n=—oo n=—oo 

From this we obtain the differentiation rule for the z-transform: 

nf[n] -o- —Zy-F(z). (18.13) 

dz 
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EXAMPLE 18.6 


18.4 


Calculating the z-transform of a signal will in general consist of applying one or 
more of the above properties, and using a number of frequently occurring transform 
pairs, some of which have been included in table 13. In the following example we 
will derive two such important transform pairs. 

The z-transform of the discrete step signal e[n\ equals F(z) — z/(z — 1), with 
the convergence region being | z | > 1 (see example 18.2 with a — 1). From the 
differentiation rule it follows that 

ne[n] —z—- 2 —- = --— ~ for | z | > 1. 

dzz- 1 (z — l) 2 

Applying the shift property gives (n — l)e[» — 1] -o- l/(z — l) 2 . Again applying 
the differentiation rule leads to 

cl 1 2z 

n(n — l)e[n — 1] •*»■ —z--—» =-—~ for | z I > 1 - 

dz (z — 1)“ (z-l) J 

Note that n(n — 1 )e[n — 1] = n(n — 1 )e[n\. This process can be repeated over and 
over again, say k times, which eventually results in the following transform pair: 


n(n — 1 )■...■ (n-k + l)e[n] A:!—— , + 1 


for | z I > 1. 


Using the binomial coefficients we can also express this transform pair as follows: 


)e[«] - ... for | z | > 1. 

\kj (z - l) k+1 

The binomial coefficients are defined, as usual, by 




n(n — 1) ■...•(« — k + 1) 
k\ 


for k = 1 , 2 ,.... 


Note that (?) = 0 for k > n. Applying the scaling property (18.11) we finally obtain 
for a 0 and k — 0, 1, 2,... the transform pair 


(| t) a " e[n] ** (z -a) k + 1 for|z|>|a| - (18 ' 14j 

We can subsequently use the time reversal rule (18.8) to derive for a ^ 0 and 
k = 0, 1,2,... that 


(z-a) k + l 

In exercise 18.6 you are asked to derive this result. 


(18.15) 

◄ 


EXERCISES 

Determine the z-transform F(z) for each of the signals /[«] given below, and de¬ 
termine the region of convergence as well: 
a f[n] = 2ne[n — 2], 
b f[n] = 2ne[-n - 2], 
c /[n] = (-l)M-«], 
d f[n] = e[4 — n], 
e /[/?] = (n 2 + n4")e[n]. 
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18.5 Determine the z-transform F(z.) for each of the following signals: 
a f[n] — cos(zJ7r/2)e[zz], 

b /[«] = sin(n7r/2)e[n], 

c f\n | = e ^e[n} + 2"e !n< ^e[—n], for a given <j>. 

18.6 Derive formula (18.15). 


Pole 


Order of a pole 


EXAMPLE 18.7 


18.3 The inverse --transform of rational functions 


In the introduction we remarked that we will not present an inverse of the z-transform. 
This does not mean that an inverse z-transform does not exist. In its most general 
form, the inverse z-transform requires a rather advanced mathematical tool. How¬ 
ever, in practice one often encounters z-transforms that are rational functions of z. 
We will therefore confine ourselves to these functions when determining an inverse. 
A rational function F(z) can be written in the form 


F(z) = 


a n z n + a n _iz n 1 -Miz + flo 

b m z m + b m -iz m ~ l -I-1- biz + bo 


(18.16) 


The numerator and the denominator contain polynomials in the complex variable 
z. Denote the numerator by P(z) and the denominator by <2(z). We assume that 
a n f 0 and b m ^ 0. Hence, the degree of P(z ) is n and the degree of Q(z) is 
m. Moreover, we will assume that numerator and denominator have no common 
factors, which means that there is no polynomial D{z) with a degree greater than 
or equal to 1 which is a divisor of both P(z) and of Q(z). Now the problem is to 
find a discrete-time signal f[n] with /[/;] -o- F{z). We know that if the region 
of convergence is not indicated, the signal /[/?] is not uniquely determined. The 
distinct regions of convergence playing a role here can be derived from the location 
of the zeros of Q(z ), which are called the poles of F(z). In chapter 2 we noted 
that every polynomial in the complex plane can be completely factorized into linear 
factors, so 


Q(z) = c(z - z\) n {z - Z 2 ) V1 ■ .. • ■ (z - z/) v/ , 


(18.17) 


where c e C, vj, vj, ■ ■ ■ ,vj are integers greater than or equal to 1, and z\, Z2> • • •, 
z/ are the distinct zeros of Q(z)- The point Zj is then called a pole of F(z) of order 
v:. We now state without proof that the distinct regions of convergence that can 
play a role in the inverse transform of F(z) are the rings bounded by the circles 
in the complex plane having radius | zj | with j — 1,2, ..., / (see figure 18.4), 
including the exterior of the largest circle and the interior of the smallest circle. For 
each ring another inverse transform can be obtained. This means that a signal /[/?] 
can be found whose z-transform is equal to the given F(z ) and whose region of 
convergence is equal to the given ring. 

Let F(z) = z/(z— 1). There is only one pole at z = 1 of order 1. One can distinguish 
two regions of convergence, namely [ z I > 1 and |z| < 1. From example 18.2 it 
follows that the signal f[n] = e[w] corresponds to the region of convergence | z | > 
1; from example 18.3 it follows that the signal f\n\ = —e[—n — 1] corresponds to 
the region of convergence | z | < 1. ^ 


In practice one usually works with signals having a finite switch-on time. For 
such signals the region of convergence of the z-transform is always the exterior of a 
circle in the complex plane, as we have already noted in section 18.1. In the theory of 
discrete systems we will encounter signals h [/z] whose z-transform is again a rational 
function and, moreover, having the property that the circle | z | = 1 belongs to the 
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FIGURE 18.4 

Regions of convergence of the z-transform. 


Absolutely summable 


EXAMPLE 18.8 


region of convergence. This implies that the series YlnL—oo h\h]z~ n is absolutely 
convergent for | z I = 1. We will call signals h[n} having this property absolutely 
summable. Hence, a signal f[n\ is absolutely summable if 

oo 

J2 I /[«] I < 00- (18.18) 

n=—o o 


Determining the inverse z-transform will be limited to absolutely summable signals 
and to signals with a finite switch-on time. We will use some examples to show how 
these signals can be obtained by using a partial fraction expansion in combination 
with a frequent application of (18.14) and (18.15). 


Let the function F(z) be given by 

Motivated by (18.14) and (18.15), both containing a factor z in the numerator, we 
do not expand F(z) in partial fractions, but instead F(z)/z: 

F(z) _ z 2 _ z 2 
z zr - 1 (z- l)(z + 1)' 

We cannot start with a partial fraction expansion immediately, since the degree of 
the numerator (2 in this case) is not smaller than the degree of the denominator 
(again 2 in this case). However, it is easy to see that z 2 = 1 ■ (z 2 — 1) + 1. Hence, 



A partial fraction expansion of l/(z 2 — 1) gives 


1 


z 2 — 1 2 


z - 1 z + 1 
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EXAMPLE 18.9 


We thus obtain that 


™=1 + I 

z 2 




or 


Hz) = 





The poles of F(z) are located at z = 1 and z = — 1. There is thus no region of con¬ 
vergence containing the unit circle. The inverse z-transform of F(z) corresponding 
to the region of convergence [ z I > 1 results in the signal fin] with a finite switch- 
on time. We can now determine the signal fin] by applying the inverse transform 
to each of the terms in the above expression for F(z), taking into account the re¬ 
gion of convergence. The term z is easy: it arises from the discrete signal <5[z? + 1]; 
use example 18.4 and apply a shift in the n-domain. Since the region of conver¬ 
gence is | z I > 1, we use formula (18.14) for the remaining terms. This results in 
f[n] = 8[n + 1] + \e[n] - £(-l)"e[n]. „ 


Let the function F(z) be given by 


F(z) = -r~-• 

(z - i)(z - 2) 

A partial fraction expansion of F(z)/z leads to 


F(z) = 


2 

3 




The rational function F(z) has poles at z = 2 and z = \- First, we are interested 
in the absolutely summable signal /[;?] having z-transform F(z). This means that 
the region of convergence has to contain the unit circle. We should keep this in 
mind when determining the inverse transform of the terms of F(z). We therefore 
use (18.14) for the inverse transform of the term z/(z — j) and (18.15) for the term 
z/(z — 2). This guarantees that the unit circle belongs to the region of convergence. 
For we then have 

2“"e[/z] ——j- for | z I > 

Z ~ 2 

2 n e[—n — 1 ] 4* -— for | z | <2. 

z - 2 

The absolutely summable signal is therefore given by 
f[n] = 1 (-2 ~ n + l e [n] - 2 n +h[-n - 1]). 


When, on the other hand, we are interested in the signal with a finite switch-on time 
having z-transform F(z), then the region of convergence is the exterior of the circle 
| z | =2. In this case the inverse transform of the term z/(z — 2) has to be determined 
using (18.14) as well. It then follows that 


2 n e[n] —-— for | z | >2. 

z - 2 


Hence, we now obtain that 


f[n\ = i(2" +1 - 2 -n+1 )e[«]. 

◄ 


Let the function F(z) be given by 


F(z) = 


1 

z(z — 2) 2 


EXAMPLE 18.10 
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EXAMPLE 18.11 


We calculate the causal signal f[n\ whose z-transform is the given function F(z). 
The poles of F{z) are at z = 0 (order 1) and at z = 2 (order 2). A partial fraction 
expansion of F(z)/z gives 


F(z) = 


1 _l-- 

z z — 2 


+ 


(z - 2) 2 


Since we are looking for a causal signal, we use (18.14) to determine the inverse 
transform of the terms in the above expression for F(z ), resulting in 

f[n] = i(5[n] + S[n - 1] - 2 >'e[n] + n2 n ~ l e[n]). 


We close this section with an example of a denominator having complex zeros. 


Let the function F(z) be given by 


F(z) = 


z 4 + z 3 — 2z + 1 
z 2 + 2z + 2 


The following steps will lead to the signal /[«] with a finite switch-on time whose 
z-transform equals the given F(z). Motivated by (18.14) and (18.15), both having a 
factor z in the numerator, we divide F(z) by z, as in examples 18.8 - 18.10: 


F(z ) _ z 4 + z 3 - 2z + 1 
z z(z 2 + 2z + 2) 

Since the degree of the numerator is greater than or equal to the degree of the de¬ 
nominator, we use a division to write the numerator in the form z 4 + z 3 — 2z + 1 = 
(z — l)(z 3 + 2z 2 + 2z) + 1 and hence 


F(z) _ , , 1 

-— z — 1 H-~-• 

z z(z 2 + 2z + 2) 


Factorizing the denominator gives the poles of F(z): z(z 2 + 2z + 2) = z(z + 1 + 
i)(z + 1 — ()• Next we apply a partial fraction expansion: 


1 A B C 

z(z 2 + 2z + 2) z z+l + i z + 1 - i 

In order to determine the constants A, B and C we note that 
1 = A(z 2 + 2z + 2) + Bz(z + 1 - /) + Cz(z + 1 + i). 


Successive substitution of the poles z = 0, z = — 1 — i, z — — 1 + i gives A = 1/2, 
B = —(1 + i)/4, C — —(1 — 0/4. Hence, 


F(z) — z 2 — z + 


1 

2 


(1 + Qz/4 
z+l + i 


(1 ~ Qz/4 
z + 1 — i 


The signal f[n] with a finite switch-on time can now be obtained using (18.14) 
again, which results in 

f[n] = 8[n + 2]-8[n + l]+ ±<5[n] 

- ±(-l)"(l + i) n+l e[n] - i(-l)”(l - i) n + l e[n] 

= 8[n + 2] - 8[n + 1] + ±8[n] - i(-l)"((l + i)" +1 + (1 - i)” +1 )e[n]. 

Note that the rational function F(z) has real coefficients. From this it follows 
that F(z) satisfies the relation F(z.) = F(z) (verify this yourself). In section 
18.2.3 we have noted that /[/;] has to be a real signal then, although this is not 
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immediately clear from the previous expression for /[«]. However, if we write 
1 ± ;' = s/le ±7T '^, then it follows from 

(1 + «)" +1 + (1 - 0" +1 = (x/2)" +1 (e iin+l)7t / 4 + e-^+JW 4 ) 

= (V2) cos + l)?r 


that 


/[«] = (5[/; + 2] - (5[n + 1] + j5[m] + cos ^(n + l)?r^ e[n]. 


EXERCISES 

18.7 Determine the real and absolutely summable signal f[n\ whose z-transform is given 
in example 18.10. 

18.8 Determine the signal f\n\ with a finite switch-on time whose z-transform F(z) is 
given by F(z) = l/(z 2 + 4). 

18.9 Determine the absolutely summable signal f[n] whose z-transform is given by 
F{z) = l/(z 2 + 4). 

18.10 Determine the signal f\n\ with a finite switch-on time whose z-transform is given 
by F(z) = z 3 /((z + jKz + 3)). 

18.11 Determine the absolutely summable signal f[n\ whose z-transform is given by 

F(z) = z 3 /((z + j)(z + 3)). 


18.4 Convolution 

For each transform considered up to now, we were able to define, for two signals 
in the time domain, a convolution product whose transform was equal to the ordi¬ 
nary product of the transforms of the signals involved. This can also be done for 
the z-transform. Let us assume that for two discrete signals f\n\ and g[n] the z- 
transforms are given by, respectively, F(z) and G(z). We then want to find a signal 
h[n] in the n-domain whose z-transform is equal to the ordinary product F(z)G(z)- 
We are thus trying to find a discrete-time signal /;[/;] such that 

oo oo oo 

h[n\z~ n = J2 fVK~ l E 8lk]z~ k . 

n =—oo /=—oo k=—o o 

In the right-hand side of this expression we have a product of two infinite series. In 
order to find an expression for h[n\, we will expand this product in a formal way 
and then sort the terms with respect to equal powers of z. By ‘formal’ we mean that 
we will not worry about possible convergence issues at the moment. The coefficient 
h[n] of z~ n is then equal to an infinite sum: 

oo 

h[n]= J2 fVMn-l]- 

/=—oo 

The series in the right-hand side arises by multiplying the coefficient of z _/ in the 
series for F(z) by the coefficient of z~ n+I in the series for G(z) and then summing 
this over all /. It is now clear how we should define the convolution product of two 
discrete-time signals for the z-transform. 
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DEFINITION 18.2 
Convolution product of 
discrete-time signals 


THEOREM 18.1 
Convolution theorem 


EXAMPLE 18.12 


For two discrete-time signals f[n\ and g[n] the convolution product (/ * g)[n] is 
defined by 


oo 

(/*«)[«]= J2 fUMn-ll (18.19) 

/=—oo 

In exercise 18.16 you will be asked to show that, similar to any of the other con¬ 
volution products, the convolution product of discrete-time signals is commutative. 

The expression in (18.19) is an infinite sum and so special attention should be 
given to convergence. We will not go into this in much detail here, and confine 
ourselves to the situation where the regions of convergence of the z-transforms of 
/[/;] and g[n] are both non-empty. The product F(z)G(z) is then certainly defined 
on the intersection of these two regions of convergence, and therefore we will sub¬ 
sequently assume that the intersection is also non-empty. In this situation one can 
show that the series in (18.19) even converges absolutely. The proof of this, as well 
as the proof of the following convolution theorem, will be omitted. 

Let f[n] and g[n] be discrete-time signals having z-transforms F(z) and G(z) re¬ 
spectively, and let V be the intersection of the regions of convergence of these z- 
transforms. Then 

(/ * *)[»] <«• F(z)G(z) for z e V. (18.20) 


Let the discrete-time signals f[n\ and g[n] be given by f[n] = 2 ~ n e[n] and g[n] = 
e[— n\. The z-transform of f\n \ follows immediately from (18.14): F(z) — z/(z — 
^) with region of convergence |z| > j. The z-transform of g[n] follows from 
(18.15): G(z) = 1/(1 — z) with region of convergence | z | < 1. The intersection of 
these two regions of convergence is the ring 2 < Ul < 1 . This region is non-empty 
and the convolution product is thus well-defined: 

oo oo 

(/**)[»]= J2 2- ( e[/]e[/-7t] = ^2- / e[/-n]. 

/=—oo /=0 

In this case one can determine the convolution product in a direct way. For n < 0 it 
equals 2 _? = 2 and for n > 0 it equals 2 — ^ = 2 1_ ”. Using e[n] this 

can be written as 

(/ * g)M = 2e[—1 — n] + 2 1_ ”e[n], 


One can also determine the convolution product using the convolution theorem. Ac¬ 
cording to the convolution theorem, the z-transform of (/ * g)[»] equals 


F{z)G(z ) = 


(z- i)(l-z)' 


By transforming this back to the n -domain one can obtain the convolution product 
as well. A partial fraction expansion gives 


2z 


(z - i)(l - z) 


2z 

1 — z 


In order to write the two terms in the right-hand side as sums of power series, we 
have to take into account that the ring 2 < I z I < 1 should be the region of con¬ 
vergence for these series. Both terms can then be written as a sum of a geometric 
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EXAMPLE 18.13 


series, converging in the indicated ring, as follows: 

r\ r\ OO 

Z T = ---r = V 2 l ~ n z~ n for |z | > i 

i 1 — (2z) _1 ^ 1 1 2 


z 2 1 n =0 

2z 00 ~ l 


= J2 2 ~" +1 = I] 2z _ " for | z | < 1. 


n =0 


Hence, for i < | z | < 1 we have 


-1 


F(z)G(z) = 2z“" + 2 1_ 


n=-oo n=0 

From this one immediately obtains the previously found expression for the convo¬ 
lution product. ^ 


In practice we are often dealing with signals in the n -domain having a finite 
switch-on time. In the previous section we have seen that the region of convergence 
of the z-transform of such signals is the exterior of a circle. The convolution product 
of these kinds of signals is again such a signal, and so the region of convergence of 
the z-transform is then again the exterior of a circle. This can be shown as follows. 
When f[n] and g[n] are discrete signals such that /[n] = g[n\ = 0 for n < N and 
some N ( N may also be negative), then the convolution product can be written as 

OO OO 

(7 * £}[»] = ^2 f[l]g[n ~ l] = ^2 fV]g[n ~ /]. 

l=—oo 1=N 


If n < 2N, then n — l< 2N — N = N for l > N and so all terms in the above series 
are 0. The convolution product is thus a signal which is zero for n < 2N. Moreover, 
the series in the convolution product contains only a finite number of terms unequal 
to zero. This is because if / > n — N we have g[n — l] — 0. We may thus conclude 
that 


(/ * <?)["] 


'n -N 

J2 /[%[»- 1 \ 

l=N 


e[n — 21V]. 


In particular, if /[n] and g[n\ are causal signals (which corresponds to N = 0), then 
the convolution product is causal as well and 


(/ * g)M 


J2 fUMn-l] 

, 1=0 


e[n\. 


Let the causal signals /[/?] and g[n] be given by /[n] = 2 "e[n] and g[n\ = 
3 - "e[n], then 

(/ * g)M = yC 2_/ 3 -( " -/) j e[«] = 3“" ^ ^ ^ e[«]. 

Hence, 

(/*«)[»] = (3 ■ 2“" - 2 • 3“")€[n]. 

The convolution product can also be found in a different way. By the convolu¬ 
tion theorem, the z-transform of the convolution product equals F(z)G(z), where 
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18.12 


18.13 


18.14 

18.15 

18.16 


F(z) = z/iz ~\) and G(z ) = z/(z — j). Hence (after a partial fraction expansion), 
3z 2z 

if * g)[»] ** -r-r- 

Z~ 2 z ~ 3 

An inverse transform gives us the same convolution product as before. ^ 

EXERCISES 

We call N the switch-on time of a signal f[n] if /[«] = 0 for n < N and /[IV] ^ 0, 
and we call M the switch-off time of f[n] if f[n] — 0 for n > M and f[M\ ^ 
0. Let f[n] and g\n] be discrete-time signals with switch-on times N\ and A3 
respectively, and switch-off times and M 2 respectively. Give the switch-on and 
switch-off time of the convolution product of /[«] and g[n], 

a Calculate the causal signal f[n] whose z-transform is given by F(z) = 
z/iz 2 + 1). 

b Use the convolution theorem to calculate the causal signal /z[/?] whose 
z-transform is given by H(z ) = z 2 /(z 2 + l) 2 . 

Show that (/ * e)[n] = E"=-oo /M- 

Use the convolution theorem to show that (/ * <5)[n] = f[n\. 

Show that the convolution product (18.19) is commutative. 


18.5 Fourier transform of non-periodic discrete-time signals 

In this section we will meet a Fourier transform for non-periodic discrete-time sig¬ 
nals. In section 18.1 we have already noted that for a discrete-time signal f[n] the 
infinite series 

00 

J2 fw e ~ inm ( 18 - 21 ) 

n——o o 

could serve as the Fourier transform of a non-periodic discrete-time signal /[/;]. In 
this section we will see that this is indeed the case. To start with, we note that if 
F(z ) is the z-transform of f\n\, then the above series arises by substituting for z the 
complex number z = e uo , which lies on the complex unit circle, into the series for 
the z-transform. Hence, 

00 

F(e im ) = J2 fWe~ ino> . 

n——o o 

An expression like this is well-known to us. In the right-hand side we have a com¬ 
plex Fourier series whose sum equals the function F(e la> ). This function is periodic 
with period 2n. It is then possible to recover f[n] from F(e ,a> ) using the well- 
known formula (3.9) for the Fourier coefficients. Applying this formula gives (note 
the sign!) 

f[n]=—f F(e ico )e ina> da>. (18.22) 

2n J- n 

We can now also interpret (18.22) by comparing it with the inverse Fourier transform 
of a continuous-time signal f(t)\ 

1 f°° 

fit) = — / F a ico)e lwt dm. 

J —OO 
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Here F a (co) is the spectrum of f{t). The signal fit ) is written here as a (continu¬ 
ous) superposition of the continuous-time harmonic signals e la>1 with frequency co. 
Formula (18.22) will now be interpreted in the same way. The discrete signal f[n\ 
is written here as a (continuous) superposition of the discrete-time harmonic signals 
e ,neo w j(jj f re q UenC y w . Analogous to the continuous-time situation, it is now quite 
natural to call F(e ,u> ) the Fourier transform or spectrum of the signal f[n], 

DEFINITION 18.3 
Fourier transform or 
spectrum of a discrete-time 
signal 


Let /[»] be a discrete-time signal. The Fourier transform or spectrum of f[n] is the 
function F(e lu> ) defined by 

oo 

F(e Uo )= J2 f\n]e~ in( ° forme R. (18.23) 

n =—oo 


The transform assigning the spectrum F(e la> ) to the function /[«] is called the 
Fourier transform for discrete signals. This should be distinguished front the DFT, 
which in first instance was created for periodic discrete-time signals. 

Because of the strong similarity with the Fourier series and the z-transform, the 
Fourier transform for discrete-time signals will have a number of analogous prop¬ 
erties. Of course, there is still the convergence issue. However, we will confine 
ourselves to discrete signals f[n] that are absolutely summable, that is, for which 
£“-ool/MI < oo. Then the z-transform of f[n] converges absolutely on the 
unit circle in the complex plane. 

We will now list a number of properties of the Fourier transform of discrete sig¬ 
nals. We omit the proofs since these properties are directly related to similar prop¬ 
erties of Fourier series or of the z-transform. In fact, these properties are simply 
reformulations of what we already know. In this listing of the properties, we use the 
transform pairs f[n\ <-> F(e lm ) andg[n] G(e lu> ). 


Linearity 

afln] + bg[n] aF{e lm ) + bG(e' m ), 

(18.24) 

Conjugation 

7M F{e~ ia> ), 

(18.25) 

Shift in the n-domain 

f[n — k\±* e~ ikw F(e im ), 

(18.26) 

Shift in the co-domain 

e inxk f[n] 

(18.27) 

Convolution in the n-domain 

OO 

(f*g)[n]= J2 msln -/]•** F(e i(0 )G(e i<0 ), 

(18.28) 


l=—oo 


1 c 71 

Convolution in the co-domain f[n]g[n\ -o-— / F(e'^ a> ~ u ^)G(e iu ) du, 

J_ n 


(18.29) 


Parseval’s identity 


Energy-content 


00 _ J /* 73 

5 finm= toL 


F(e la> )G(e lm ) dco. 


(18.30) 


From Parseval's identity it immediately follows that the energy-content of a 
discrete-time signal (see section 1.2.3) is given by 


°° 1 /* 71 


F(e lm )\ dco. 


( 18 . 31 ) 
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EXAMPLE 18.14 


18.17 


18.18 

18.19 

18.20 


18.21 


Let f[n] be the causal signal given by f[n\ = 2 ~ n e[n\. The z-transform F(z) 
equals F(z) — z/(z — 5 ). The Fourier transform equals F(e ico ). According to the 
left-hand side of (18.31), the energy-content of /[/;] equals 

oo oo A 

E l/WI 2 = E 4 “"-3' 

n=—oo n =0 


and according to the right-hand side it equals 

l2 1 m „—/&> 


A £ | F<o I <fc> = ^ 


hi 

i r 71 i 
27r J_ n 5/4 — cosa> 


2tr ./_* ( e i® _ 1) - 1) 


rto. 




We have thus found that 


£ 


1 8 ?r 

-rfa) = —. 

5/4 — cos w 3 


EXERCISES 

Given is a discrete-time signal /[«] with spectrum F{e uo ). Show that 
F(e i0} ) 




/=—oo 


2c' w - 1 




Show that the spectrum F(e lu> ) of a real signal f[n] satisfies F(e l< °) = F(c ,a> ). 
Is the converse statement also true? 

Calculate the energy-content of the signal f[n} whose spectrum is given by 
F(e la> ) = coso). 

The autocorrelation p[n] of a discrete-time signal f[n] is defined by 

oo 

pw = E 7m/[» + /]. 

/=—oo 

Calculate the spectrum of /o[w]. 

Show that 5[/?] = ^ e ina} dco. 


SUMMARY 

In this chapter the z-transform F(z) — 5Z«£-oo has been introduced as 

an operation on non-periodic discrete-time signals. In general, the region of conver¬ 
gence of the z -transform is a ring in the complex plane, whose boundary is deter¬ 
mined by the radius of convergence of the anti-causal part and of the causal part. 

The properties of the z-transform are very similar to the other transforms that have 
been treated earlier. A table of properties is included at the back of this book (see 
table 14). For the reconstruction of a signal from a given z-transform it is important 
that the region of convergence is known. In practice, mainly signals occur whose 
z-transform is a rational function of z. If we then know that the signal is absolutely 
summable, or that it has a finite switch-on time, then we can recover the original 
signal by means of a partial fraction expansion. The absolutely summable signals 
will play a role in the study of stable discrete-time signals in chapter 19. 
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18.22 


18.23 


18.24 


18.25 


From the z-transform F(z) of a signal f[n\ one obtains the Fourier transform of 
/1 n | by substituting z = e ,0> . The quantity a> is then called the frequency, and the 
Fourier transform F(e ,a> ) the spectrum of f[n\. Properties of the Fourier transform 
follow immediately from the theory of the Fourier series, since the Fourier transform 
of /[«] represents a Fourier series. Using Parseval’s identity for periodic functions 
one can then easily obtain the energy-content of the signal f\n |. 


SELFTEST 

A discrete-time signal f\n\ is given by f\n\ = 2 ~"e[n + 2], 
a Determine the region of convergence of the z-transform F(z) of /[«] and cal¬ 
culate F(z)- 

b Calculate the signal g[«] given by g\ri\ = Yl'i'=-oo /M- 
c Determine the Fourier transform of /[«]. 

For a discrete-time signal /[«] the z-transform F(z) is given by 

,2 

F(z) = 


z + 2 

a Calculate /[n] if in addition it is given that /[«] is absolutely summable. 
b Determine the Fourier transform of f[n\. 
c Calculate the spectrum of 2" / [n ]. 

For a causal discrete-time signal f[n] the z-transform F(z) is given by 

1 

F(z) = -=-. 

z(4z 2 + 1) 

a Show that f[n\ is absolutely summable and determine the spectrum of f[n], 
b Calculate f\n], 

c Is the signal f[n\ real? Justify your answer. 


For a discrete-time signal f[n] it is given that 


f\n] = ^g[/]g[« - /]. 

1=0 

Here g[n] is a real and causal signal whose spectrum is given by 
1 


G(e ) = 

4 + cos(2w) 

Determine the z-transform of /[«]. 
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CHAPTER 19 


Applications of discrete transforms 


INTRODUCTION 


Applications of discrete transforms can mainly be found in the processing of dis¬ 
crete signals in discrete-time systems. In chapter 1 we have already discussed such 
systems in general terms. Since we now have certain discrete transforms available, 
we are able to get a better understanding of the discrete systems. Hence, in the 
present chapter we we will focus on a further analysis of the discrete-time systems. 

In systems theory we distinguish inputs and the corresponding outputs or re¬ 
sponses of the system. For discrete-time systems these signals are discrete-time 
signals. A system can be described by giving the relation that exists between the in¬ 
puts and the outputs. This can be done in several ways. For example, by describing 
the relation in the n -domain, or in the z-domain, or, just as important, by describing 
it in the frequency or cu-domain. In the latter case we have the relationship between 
the spectra of the input and outputs in mind. 

Discrete transforms play a special role in linear time-invariant discrete systems, 
similar to the role played by the Fourier integral in continuous-time systems (see 
chapter 10). Linear time-invariant systems have already been introduced in chapter 
1 (see section 1.3.2). Discrete-time systems that are linear and time-invariant will 
henceforth be called LTD-systems for short. In section 19.1 we will see that for an 
LTD-system the relationship between an input and the corresponding output can be 
described in the n -domain by means of a convolution product. The response to the 
discrete unit pulse, the so-called impulse response , is of fundamental importance 
here. In fact, an LTD-system is completely determined by the impulse response. 
Hence, all kinds of properties of a system can be derived from the impulse response. 
Some of these properties, such as stability and causality of systems, will be exam¬ 
ined in section 19.1. 

From the convolution theorem of the z-transform it will follow that for LTD- 
systems the relationship in the z-domain between the input and the output is simply 
a multiplication by the so-called transfer function. The behaviour of the system 
is completely determined by this transfer function. Hence, all kinds of properties 
of a discrete-time system can then be derived from the transfer function as well. 
Restricting the transfer function to the unit circle in the complex plane leads for 
stable systems to the well-known frequency response of a system, which has already 
been introduced in chapter 1. It shows precisely how the spectrum, or the Fourier 
transform, of a discrete-time signal is effected by a linear time-invariant system. The 
transfer function and the frequency response will be treated in section 19.2. 

Next we consider in section 19.3 LTD-systems described by difference equations. 
These LTD-systems are of practical importance because precisely these systems can 
be realized by means of computers. These systems have a rational transfer func¬ 
tion. The stability of an LTD-system follows front the location of the poles of this 
function. 
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LEARNING OBJECTIVES 

After studying this chapter it is expected that you 

- know the concepts of impulse response and step response of an LTD-system and 
can determine these in simple situations 

- know and can apply the relationship between an input and the corresponding out¬ 
put using the impulse response 

- can use the impulse response to verify the stability and the causality of an LTD- 
system 

- know the importance of the concepts of transfer function and frequency response 
of an LTD-system 

- can use the transfer function to verify the stability and the causality, in particular 
for a rational transfer function 

- know the importance of the transfer function in relation to the response of an LTD- 
system to the input z n 

- can analyse causal LTD-systems described by a difference equation. 


DEFINITION 19.1 

Impulse response 


LTD-system 


19.1 The impulse response 

In this section we introduce the impulse response of an LTD-system and we show its 
importance in relation to LTD-systems. Therefore we will start with the definition of 
the impulse response. 

The impulse response h [/;] of an LTD-system is the response to the discrete unit pulse 
S [«]. This is denoted by 

S[n ] i-> h[n], (19.1) 

As a first illustration of the importance of the impulse response, we consider a simple 
LTD-system, which calculates a weighted average of an input u[n] in the following 
way: 


u[n ] + 2 u[n — 1] + u[n — 2] 

>’ [ n | = --- 


for n € Z. 


(19.2) 


At time n the output y[n\ is equal to a weighted average of the previous three values 
of the input u[n\ (a running average). It is not difficult to show that this defines 
an LTD-system (see exercise 19.1). For convenience we repeat the definitions of a 
linear and time-invariant system here (see definitions 1.1 and 1.2). 


A discrete-time system L is called linear if for all complex a and b and all inputs 
;/[/;] and v[rc] one has 


au[n\ + bv[n\ a(L«)[/?] + fe(Lv)[n] for n e Z. 


A discrete-time system L is called time-invariant if for all integer 1 and all inputs 
u\n\ one has 


u[n — /] i—>- (L u)[n — l]. 

Time-invariant systems have the property that a shift in time in the input results in 
the same shift in the output. Apparently, the system consists of components whose 
operation does not vary in time. Keep in mind, for example, an electric network 
where, among other things, the capacity of a capacitor, or the inductance of an 
inductor, does not depend on time. 
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EXAMPLE 19.1 


Time-delay unit 


We now determine the impulse response h[n] of the system defined by (19.2). 
Substitution of 5[»] = u[n] in (19.2) gives 

, r , 5[n] + 25 [m - 1] + 5 [n - 2] 

h[n] = ---. 

We conclude from this that 

/t[0] = 3 , h[ 1] = M2] = 3 , h[n] = 0 forn^ 0,1,2. 

Therefore, relation (19.2) can also be written as 

00 

y\n] = h[0]u[n] + h[\\u[n — 1 ] + h[2\u[n — 2] — h\I]u[n — /]. 

/=—00 

Apparently, the output v[/z] is nothing else but the convolution product of the signal 
h[n] and the input u\n]. We will now show that this property holds in general for all 
LTD-systems. In doing so, we tacitly assume, as for LTC-systems (see chapter 10), 
that LTD-systems satisfy the superposition rule (see section 10.1), that is to say, the 
linearity property is not only valid for finite series of inputs, but also for convergent 
infinite series. 

Let u[n] be an arbitrary input of an LTD-system. Using the representation (see 
chapter 15, (15.2)) 

00 

u\n] = u[l]8[n — /]. 

/=—00 

the input u[n ] has been written as a superposition of shifted discrete unit pulses. 
The system is time-invariant, so the response to 5[n — /] is li[n — /]. Applying the 
superposition rule, we find the following relation for the response y[n] to the input 
u[n]: 

00 

y[n\ = u[l]h[n — /]. 

/=—00 

This establishes the following important property of LTD-systems. 

For an LTD-system with impulse response h[n], the response y[n\ to an inputu[n] 
is given by 

y[n] = (h *«)[n], (19.3) 

If we know the impulse response of an LTD-system, then the above implies that the 
response to any arbitrary input can be determined by calculating a convolution prod¬ 
uct. Apparently, an LTD-system is completely characterized by its impulse response. 

An LTD-system for which the relationship between an input «[n] and the response 
y[/z] is given by 

y[/z] = u\n — 1 ] 

is called a time-delay unit. The impulse response of the time-delay unit thus equals 
h[n] = 5 [n — 1], By (19.3), the relation between y[n ] and u[n] can then also be 
written as 

00 

y[/z] = E u[l]8[n — l — 1 ]. 

/=—00 


◄ 
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EXAMPLE 19.2 


Multiplier 


THEOREM 19.1 
Stability 


Let a e C. The LTD-system for which the relationship between an input u[n\ and 
the response y[n] is described by 

y[ri] = au[n] 

is called a multiplier. The impulse response equals h[n ] = a&\n\. By (19.3), y[n\ 
can also be written as 

oo 

y[n] = a u[l]S[n — /]. 
l=—oo 

•4 


The time-delay unit and the multiplier are important components in LTD-systems 
that can be realized by digital computers. We will not go into this any further in 
this book. Relation (19.3) between an input u[n ] and the response y[ti\ of an LTD- 
system is one of the important applications of the convolution product. Here we 
state without proof that the condition for the existence of the convolution product is 
satisfied if we confine ourselves to bounded inputs and, moreover, assume that the 
impulse response is absolutely summable, that is to say (see (18.18)), 

oo 

| h[n] | < oo. 

n=—o o 

In this situation one can show that the series arising when we expand the convolution 
product in (19.3) is also absolutely convergent. Moreover, an LTD-system with an 
absolutely summable impulse response is stable (see theorem 19.1 below). Stability 
of systems has been defined in chapter 1 (definition 1.3) and means that bounded 
inputs result in bounded outputs. For LTD-systems this property can be verified 
using the impulse response, as is shown in the following theorem. 

An LTD-system with impulse response /;[«] is stable if and only if 
oo 

Y | h[n] | < oo. (19.4) 

n=—o o 


Proof 

First assume that /;[/?] is absolutely summable and that YUnL-oo I h[n\ | = / < oo. 
If u|n | is now a bounded input with | u[n] \ < L for all integer n and some L > 0, 
then 


I yM | 


OO 

h[l]u[n — l] 

/=—oo 


oo 

<L y \h[l]\ = L- I. 

/=—oo 


Hence, the output is bounded as well and it has upper bound LI. Therefore the 
system is stable. 

Next let us assume that the given LTD-system is stable. A response to a bounded 
input is then bounded. The discrete unit pulse is a bounded signal. The response to 
this, the impulse response h[n\, is thus a bounded signal. Now consider the bounded 
input u\n] given by 


u[n] = exp (—i arg h[—ri\). 

By the stability, the corresponding output y [n] is then also bounded and y[0] has the 
value 

oo oo 

v f °] = exp(—(' arg h[-l])h[-l] = Y 

/=—OO /=—OO 
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EXAMPLE 19.3 


EXAMPLE 19.4 


EXAMPLE 19.5 


Apparently, the series in the right-hand side is convergent and has sum y [0]. This 
proves the theorem. g 

We note here that the choice u\n ] = exp (—i arg/;[—«]) in the proof above is a 
consequence of the assumption that the impulse response may be complex-valued. 
Since h[—l] = | h[—l\ | exp(; arg/;[—/]), one has that 

exp(—z arg/z[— I])h[—I] — exp (—i arg/zf—/]) | h[—l] | exp(z arg/?[—/]) 

= \h[-l] I. 

The time-delay unit is a stable system with /z[zz] = <5[n — 11. For, 5[n] 5[/z — 1] = 

/z[zz] and 

oo oo 

E \ h M\= E I <5[n - 1 ] | = 5[0] = 1 . 

n=—o o n——o o 

Verify for yourself that the stability of the time-delay unit can easily be checked in 
a direct way using definition 1.3. ^ 

The multiplier is a stable system with h[n] — a8[n]. For, <5[/z] a&[n} = h[n] and 

oo oo 

E \ h M\ = E I <*«[«] I = I fl I - 

n =—oo n=—o o 

The stability of the multiplier is also easy to verify using the definition. ^ 

Consider the system u[n] y[n] defined by 
n 

y\n\ = E “W- 

/=—OO 

The impulse response h[n] equals 
n 

h[n] = , 5 I / 1 = e[«]. 

/=—OO 

This system can therefore be described by 

n oo 

y[n] = u[l] = u[l\e[n — l] = (e * u)[n). 

/=—oo /=—oo 

The system is an LTD-system, but it is not stable since 

oo 

E ii = °°- 

n=—oo 

Also prove the instability using the definition. ^ 

We have seen that the stability of an LTD-system is determined by the absolute 
summability of the impulse response. This is not very surprising. Property (19.3) 
states that an LTD-system is determined by the impulse response. This means that 
one should somehow be able to derive all kinds of properties of an LTD-system from 
the impulse response. For example, the causality of an LTD-system can also easily 
be checked using the impulse response, as our next theorem will show. Causality of 
a system was defined in chapter 1 (definition 1.4). For LTD-systems causality means 
that the response to a causal input is again causal. Recall that a signal /[;;] is causal 
if f[n ] = 0 for n < 0. 
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THEOREM 19.2 
Causality 


Rea! discrete-time system 


Step response 


EXAMPLE 19.6 
Detection filter 


An LTD-system is causal if and only if the impulse response h[n] is a causal signal. 
Proof 

We will be using theorem 1.2 from chapter 1. From that theorem it follows that an 
LTD-system is causal if and only if the response to an arbitrary causal input is again 
causal. 

First assume that the LTD-system is causal. Since <5[n] = 0 for n < 0, the discrete 
unit pulse is a causal signal and so the response h\n | is causal as well. 

Let us now assume that h[n] is a causal signal and let u[n\ be a causal input. Then 
the causality of h[n] and (19.3) imply that 

oo n 

yin] = E u[l\h\n — /] = u[l]h[n — /]. 

/=—oo /=—oo 

Since u[l] = 0 for all l < 0, all terms in the above series are zero for n < 0. Hence, 
y[n] = 0 for n < 0, which means that v[zz] is a causal signal. This finishes the 
proof. g 

Both the time-delay unit and the multiplier are examples of causal LTD-systems. 
Useful systems are usually required to be stable and causal. 

Besides causality and stability one can also require a system to be real. A discrete¬ 
time system is called a real system if the response to any real input is again real. 
Show for yourself that an LTD-system is real if and only if the impulse response is 
real. The time-delay unit is an example of a real system, but the multiplier is a real 
system only if the number a is real. 

In the above we have seen that one can obtain all kinds of properties of an LTD- 
system from the impulse response. Another special response that one may encounter 
in LTD-systems is the response to the discrete unit step function e[«], This response 
is called the step response and is denoted by a[/z], so 

e[/z] a[n], (19.5) 

If we know the step response of an LTD-system, then the impulse response is ob¬ 
tained in the following way. Since <5[zz] = e[/z] — e[n — 1], the linearity and the 
time-invariance of the system imply that 

h[n] = n[/z] — a[n — 1]. 

Hence, once the step response is known, one can use the impulse response and 
(19.3) to determine the response to an arbitrary input. We close this section with 
an example of an LTD-system that is known as a detection filter, which allows us to 
detect signals. 

Let x[n] be a given discrete-time signal with x[n\ = 0 for \ n\ > N and some 
N > 0. Consider the discrete-time system L given by 

oo 

u[n] y[ n ] = u\m]x\m — n\. 

m——o o 

The linearity of this system is easy to check. The time-invariance follows from 

oo oo 

u[n — /] i—>- u[m — l]x[m — n] = u[m\x[m — (n — /)]. 

m=—o o in =—oo 

The impulse response /z[/z] of the system is equal to h[n] = x[—n]. Since only a 
finite number of terms of x[n\ are unequal to zero, it follows from theorem 19.1 that 
the system is stable. Moreover, theorem 19.2 implies that the system is causal if and 
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19.1 

19.2 


19.3 

19.4 


only if v[/z] = 0 for n > 0. Finally, we also note that the system is real if the signal 
x[n] is real. We call this LTD-system L a detection filter because of the following. 
From the Cauchy-Schwarz inequality (see exercise 19.7) it follows that 


I y[0] I 


N 

u[m]x[m] 

m — — N 


N _ 

— ^2 | u[m] | | x[m] 

m=—N 


N 

^2 \u[m] | \x[m] | 

m=—N 


N 


N 


^2 \u[m] | 2 ^2 \x[m] | 2 


m=—N 


m=—N 


In addition, we know that in this inequality there is an equality if and only if for 
some o' e C 


u[n\ = ax[n ] for/z e Z, 

independent of n. Hence, when a number of signals is applied to the system, in¬ 
cluding the signal x[n] itself, then one can detect whether the input agrees with the 
signal x[n] by measuring _y[ 0 ]. ^ 


EXERCISES 

Show that the system defined by (19.2) is an LTD-system. 

Determine the impulse response of the LTD-systems given below and verify property 
(19.3): 

a y[«] = E"r! 00 2 , -"«[/], 
b y[/z] = (u[n — 1 ] + u[n + l])/2, 

C y[n] = j:™n 2 l ~ n u[ll 

Which of the discrete-time systems given in exercise 19.2 are causal and which of 
them are stable? Justify your answer. 

For an LTD-system the impulse response is given by h[n] = <5[n| — 25[« — 1] + 

5[iz - 2 ], 

a Determine the step response, 
b Determine the response to an arbitrary input ;<[zz]. 

For an LTD-system the step response is given by a[n} = 2~ n e[n] — 3 ~"e[n — 1], 
d [(Deteenine)-250(the)-250(response)-250(to)-599 -1.22.599 -j/Tl 21 /T9 Tf 0645 0 Td (y) Tj, 
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DEFINITION 19.2 

Transfer function 


a Show that for all complex X one has 

m / m , | \ / ,n \ m 

ka n I 2 = ( E \ a n | ) I * I 2 - 2Re I A. ) + J2 | b » | - °- 

n= 1 \n=\ / \ «=1 / «=1 

b Let </> = arg a nb n ) and A, = fe~ i( ^ with ft arbitrary real. Show that for 

all real f one has 


Ebb 2 - 2 - 6 

n= 1 


m 

^ ' a n^n 
n=1 


+ E| 

«=1 


> o. 


c Show that part b implies that 


^ ' a nbn 
n=1 


E i 2 


\j »=1 


E i i 2 - 


\] «= 1 


d Show that if we have an equality-sign in the above inequality, then a ft > 0 
exists such that 


Ebb 2 - 2 - 6 


^ ' a nbn 
n=1 


+ E =°- 

«=1 


e Show that for the value of p found in part d one has 


m 2 

E b n ~ Pe^an " = 0. 

n= 1 

From this it follows that b n = fte'&a,, for all n. Hence, in the case of an equality 
the sequence b n is a (complex) multiple of the sequence a n . 


19.2 The transfer function and the frequency response 

In the previous section we have seen that property (19.3) gives an important descrip¬ 
tion of an LTD-system in the n-domain. In this section we study the relation between 
the input and the output in the z-domain, which will lead to the introduction of the 
so-called transfer function. Moreover, we will study how an LTD-system effects the 
spectrum of an input. Here the frequency response of an LTD-system, introduced in 
chapter 1 ((1.8)), comes into play. 

It is quite obvious to apply the convolution theorem to (19.3). When U(z) and 
H(z) denote the z-transforms of the signals u\n\ and h\n\ respectively, then it fol¬ 
lows from the convolution theorem that the "-transform Y (z) of the output y[n] is 
given by 

Y(z) = H(z)U(z). (19.6) 

Apparently, the relation between the input and the output has a simple description 
in the z-domain. It consists of an ordinary multiplication by the z-transform H(z ) 
of the impulse response h [n], which we will call the transfer function of the system. 

The transfer function H(z) of a system is defined by 

oo 

H(z)= E * 
n =—oo 


(19.7) 
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EXAMPLE 19.7 

EXAMPLE 19.8 

EXAMPLE 19.9 


THEOREM 19.3 


for those values ofz € C for which the series converges. 

The transfer function H(z) of the time-delay unit, as given in example 19.1, is equal 
to the z-transform of the impulse response <5[« — 1], and so H(z) = 1/z for z 0. ^ 

The transfer function H{z) of the multiplier, as given in example 19.2, is equal to 
the z-transform of the impulse response h[n\ = aS[n], and so H{z) = a for all 
zeC. M 

The transfer function H(z) of the detection filter, as given in example 19.6, is equal 
to the z-transform of the impulse response h[n] — x[— «], where x[n] is a discrete¬ 
time signal with x\n\ = 0 for \ n\ > N. When X{z) denotes the z-transform of 
x[n], then it follows from properties (18.8) and (18.9) that H(z) = X(l/z). ^ 

Since an LTD-system is completely determined by the transfer function H(z), 
one should be able to derive all kinds of properties of the system from the transfer 
function. The first property we consider is the causality of an LTD-system. An LTD- 
system is causal if and only if h[n] is causal. Then the z-transform H(z) consists of 
only the causal part 

oo 

H(z) = ^/i[n]z“", 

n=0 

and we know that the region of convergence is then the exterior of a circle in the 
complex plane. Moreover, from the z-transform it can be derived that 

lim H(z) = h[ 0], (19.8) 

|z |->00 

One can show that the converse is also true. This means that we have the following 
theorem. 

Let an LTD-system with transfer function H (z) be given. The LTD-system is causal 
if and only if: 

a the region of convergence of H{z) is the exterior of a circle: 
b lim|, 1 -j.oo H{z) exists. 

Theorem 19.3 has some special consequences for LTD-systems whose transfer 
function is a rational function of z, so H (z) = P{z)/Q(z), where P(z) and Q(z) are 
polynomials in z without common zeros. The region of convergence is the exterior 
of a circle. For a rational function H(z) this is the circle passing through a pole of 
H(z ) with maximal distance to the origin. Since H (z) has a limit for | z I —>• oo, 
this implies that the degree of the numerator P(z) cannot be greater than the degree 
of the denominator Q(z)■ 

Next we consider the stability of a system. From theorem 19.1 we know that a 
system is stable if and only if YlnL—oo I I < oo. But since 

oo oo 

y. \h[n]\= | h[n]z~ n \ for | z | = 1, 

n=—oo n=—o o 

we may conclude that an LTD-system is stable if and only if the transfer function is 
absolutely convergent on the unit circle | z | = 1 in the complex plane. As a con¬ 
sequence we have the following theorem for causal LTD-systems having a rational 
transfer function. 


THEOREM 19.4 


Let L be a causal LTD-system with a rational transfer function H(z ) = P (z) / Q(z), 
where P(z) and Q(z) are polynomials of degree n and m respectively, and without 



19.2 Transfer function and frequency response 


421 


EXAMPLE 19.10 


Eigenfunction 

Eigenvalue 


Frequency response 


common zeros. Then the following statements hold: 
a n < m; 

b the system is stable if and only if the poles of H(z) lie inside the unit circle in 
the complex plane. 

Proof 

Statement a follows from theorem 19.3, as we have already noted. We now prove 
statement b. 

First assume that L is stable. The region of convergence of H(z) must then con¬ 
tain the unit circle. Theorem 19.3 then implies that the region of convergence is the 
exterior of a circle. For a rational function H{z) this is the circle passing through 
a pole of H{z) with maximal distance to the origin. Hence, all poles of H(z) lie 
inside the unit circle. 

Now assume that the poles lie inside the unit circle. By the causality, the region of 
convergence is the exterior of a circle. This must contain the unit circle. Therefore 
the system is stable. g 


For a causal LTD-system L the transfer function H{z) is given by 


H(z) = 


z 

4z 2 + 1' 


Because of the causality of the system, the impulse response is a causal signal. The 
region of convergence of H(z) is thus the exterior of a circle in the complex plane. 
Since H(z) is a rational function with poles at z = =t//2, we conclude that the 
region of convergence is | z I > 1/2. This contains the unit circle and so the causal 
system is stable. The impulse response can be found by an inverse transform of 
H(z), resulting in 

h[n] = 2 - " -1 sin(njr/2)e[n]. 

◄ 


The transfer function plays an important role in the response to the special input 
u[n] = z n with z e C. 

If z belongs to the region of convergence of H(z), then 

z n H(z)z n . (19.9) 

This can immediately be derived from (19.3) as follows: 

oo \ 

Y h[l]z- l )z n . 

/=—oo / 

Because of (19.9), the signal z n is sometimes called an eigenfunction of the LTD- 
system, and H(z) the corresponding eigenvalue. 

In chapter 1 the frequency response H(e IOJ ) of an LTD-system has been defined 
using the response of an LTD-system to the input e ,na> \ 

e in(0 i-» H(e i0J )e in(0 . (19.10) 

We now see that this rule follows immediately from (19.9) by substituting z — e la> . 
This then justifies the notation H(e uo ) for the frequency response of an LTD-system. 
Apparently one has the following important property: 

The frequency response is equal to the spectrum of the impulse response: 


An] = Y h Vk n ~ l = 


/=—OO 


oo 

H(e i(0 )= Y h ln]e~ inQJ . 
n =—oo 


(19.11) 
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Now the spectrum of /;[/;] is only defined for those frequencies for which the series 
in the right-hand side of (19.11) converges. However, if the system is stable , then 
h[n] is absolutely summable and the above series is therefore absolutely convergent 
for all real a> since \h[n\e~ lnm \ = [ /;[«] |. Hence, for stable systems the frequency 
response is defined for all frequencies a>. One can even show that the function 
H(e ,0J ) is a continuous function of a>. 

Since H(e ,a> ) is complex, we can write 

H(e ic0 ) = | H(e io> ) | e' 0(<u) . (19.12) 

Amplitude spectrum As usual we call \H(e lm )\ and 4>(a>), respectively, the amplitude and phase spec- 

Phase spectrum trum. The phase spectrum is determined up to a multiple of 2n. The significance of 

the amplitude and phase spectrum for LTD-systems will now be demonstrated for a 
real and stable system by looking at the response to the following sinusoidal signal 
u[n\ for a positive frequency or. 

u[n ] = A cos(nct) + cf>). 

Here A, f and u> are real constants and u> > 0 is the frequency of the signal. By 
changing to complex exponentials, we can write the input as 

u[n\ = ±A(e ! ' < V n<u + e-^ e~ inm ). 

Applying the linearity of the system and property (19.10) leads to the following 
expression for the output y[n\\ 

y[n] = {Aie^ H(e ia> )e ino) + e^ H{ e - iw ) e - inw ). 

Now check for yourself that for real systems one has 


H(e~ ia> ) = H(e Uo ), 

and then note that this implies that y[«] = ARe(H(e io) )e i( ^e inw ). Finally we use 
(19.12) to write y\n] as follows: 

y[n] = A | H{e im ) | cos (not + f + <F(w)). (19.13) 

The output has the same frequency as the input, only the amplitude is multiplied by 
a factor \H{e lm )\ and there is a phase shift <l>(co). 

Often, LTD-systems are described by indicating what the frequency response is 
like. When U ( e la> ) is the spectrum of «[»] and Y ( e lu> ) is the spectrum of the corre¬ 
sponding output y[n\, then it follows from (19.6) that 

Y(e ia> ) = H(e iol )U(e ia> ). (19.14) 

This property shows us how the LTD-system effects the spectrum of an input. If we 
know the frequency response, then by (18.22) the impulse response h\n ] is 

h [n] = 1- j n H(e i( °)e ina> dco. 


( 19 . 15 ) 
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EXAMPLE 19.11 
Ideal low-pass filter 


and so the LTD-system is again completely determined. The output can then be 
found using (19.14) and again (18.22): 

y \n]=—f H(e iu, )U(e i,0 )e in(0 da). (19.16) 

2?r J-7T 


From (19.16) we conclude that if u[n\ contains the components U(e ,0> )e lno> , then 
y\n ] contains the components H(e l(0 )U{e ,(0 )e lnu> . The component having fre¬ 
quency a) gets a phase shift $(«) and is amplified by a factor \ H{e ,u> )\. 


Consider an LTD-system whose frequency response on the interval (—n, n) is 
given by 


H(e io1 ) 


1 for | to | < o) c < n, 
0 for o) c < \ a) \ < n. 


(19.17) 



FIGURE 19.1 

Frequency response of an ideal low-pass filter. 

A graph of the frequency response is drawn in figure 19.1. The LTD-system defined 
by (19.17) is called an ideal low-pass filter since the components of an input u\n] 
with frequencies a> in the pass-band (—co c , a>c ) can pass undisturbed, while the other 
components are blocked completely. The impulse response follows from (19.15) 
and in our example it is equal to 

e‘™da> = sitfinoO 


The problem with the ideal low-pass filter is that the frequency response cannot 
be written as a rational function of e ,a> , in other words, that the transfer function is 
not a rational function of z. In practice this implies that an ideal low-pass filter can 
only be approximated. In this book we will not go into this any further and so we 
refer to the relevant literature (e.g. Digitate signaalbewerking by A.W.M. van den 
Enden and N.A.M. Verhoeckx (in Dutch)). 

The LTD-systems with a rational transfer function are important, because they 
can be realized using time-delay units, multipliers and adders and, moreover, can be 
described by means of so-called difference equations. In the next section we will 
study these LTD-systems described by difference equations. 

EXERCISES 

For an LTD-system the impulse response is given by h\n\ = 2~ n cos(rc0)e[/?]. Here 
is a real constant. Calculate the transfer function of the system and verify whether 
the system is stable. 


1 

,m = 2 *L 


19.8 
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19.9 

19.10 

19.11 

19.12 

19.13 


19.14 


For a stable LTD-system the transfer function is given by 


H{z) = 


9 z 2 + 6z + 1 


a Determine the impulse response, 
b Calculate the response to the input u[n] = sin(njt/2). 


For a causal LTD-system the transfer function is given by 


H(z) = 


z + 1 

(z- l)(2z+ 1)' 


a Determine the impulse response /i[n], 
b Is the system stable? Justify your answer. 

For a stable LTD-system the frequency response is given by H(e lu> ) = 1+2 cos(2«). 
a Determine the response to the input u\n] = S\n — 2|. 
b Is the system causal? Justify your answer. 


Show that the amplitude and phase spectrum of a real LTD-system are, respectively, 
an even and an odd function of the frequency a>. 

For a discrete band-pass filter the frequency response is given by the graph from 
figure 19.2. Determine the impulse response of the filter. 



FIGURE 19.2 

Frequency response of the ideal band-pass filter from exercise 19.13. 


Let L be a stable LTD-system with frequency response H{e lu> ) and w[/i] an input 
with finite energy-content and spectrum U(e l0> ). Show that the energy-content of 
the output y[n\ is given by 

1 r* i . . i2 

— j | H(e ,l0 )U(e l(0 ) | dm. 


19.3 LTD-systems described by difference equations 

An LTD-system can be specified by describing the relationship between an input 
u[n] and the corresponding response y [n]. As we have seen, this can be done in 
several ways. For example, in the n-domain by using the impulse response h[n], 
or in the z-domain by means of the transfer function H(z). In this section we will 
examine an important class of LTD-systems, namely the LTD-systems that can be 
described by difference equations. We have seen that the time-delay unit, introduced 
in example 19.1, can be described by the equation 


y[n] = u[n — 1 ], 
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Difference equation 


Non-recursive system 
Recursive system 


A somewhat less elementary example of an LTD-system is obtained by also adding 
u\n \ and other delays of u[n ] to such an equation. More generally, one can consider 
the following equation: 

y[n] = apu[n] + ci\u[n — 1] + • • • + ay/u[n — N]. (19.18) 

An example of this is the LTD-system that calculates a weighted average of an input 
according to (19.2). When the input u[n\ is known, then the output y[ n ] can easily 
be calculated by substituting u[n], u[n — 1], ..., u[n — N ] into (19.18). In exercise 
19.6 you were asked to show that (19.18) does indeed define an LTD-system, being 
causal as well. 

A slightly more complicated equation is obtained by allowing in addition delays 
of y[ri\. The most general situation considered by us is described by 

y[n] + b\y[n — 1] + • • • + by]y[n — M] = aou[n] + • • • + ajyu[n — N]. (19.19) 

We call (19.19) a difference equation. Here the signal u[n ] is considered as a given 
signal. A difference equation is thus an equation of type (19.19) for the unknown 
signal y[n ] and with u[n ] given. Equation (19.18) is a special case of (19.19): for 
ft] = ft 2 = ... = byj = 0 one obtains (19.18). In order to determine y[/?] from 
(19.18) we only need the signal u[n]. This is in contrast to (19.19). In the latter 
equation we also need y[n — 1], y[n — 2],,.., y[n — M\ in order to determine y[n\. 
A system described by (19.18) is called a non-recursive system. A system described 
by (19.19) is called a recursive system. 

There is yet another complication when defining a system by means of (19.19). 
For a given ;/[n] there will, in general, be several solutions y[n ] satisfying (19.19). 
If we know the values of the output y[n] for n = — 1, — 2,..., — M, as the result of a 
given input u[n], then we see that substituting n = 0 in (19.19) will lead to the value 
y[0]. By subsequently substituting n = 1, we obtain the value y[l]. This process 
can be repeated, and so we see that eventually y[/r] will be uniquely determined for 
every n > 0. When, for example, the system is causal and u[n] is a causal input, 
then the output y[n\ is causal and so y[— 1] = 0, y[—2] = 0, ..., y[— M] = 0. 
Consequently, y[n] is uniquely determined by the difference equation. 

We will confine ourselves to causal LTD-systems described by (19.19). First we 
will show that a causal LTD-system is completely determined by (19.19). To this 
end we apply the z-transform to the left- and right-hand side of (19.19). If we put 


u\n \ <-> U (z) and y[n] •*> T(z), 

then it follows from the linearity and the shift property (18.10) for the z-transform 
that 

(1 + b lZ ~ l -h b M z~ M )Y{z) = (oq + 4-f a N z~ N )U(z). 


The transfer function H(z) is thus equal to 

_ Y{z) _ ap + aiz~ l H- Va N z~ N 

U(z) l+ftiz _1 -|-h by]Z~ M 

This shows that the transfer function is a rational function: 

tj , , M-N a N + a N-iZ + ■ ■ ■ + apZ N 

ti (z) = Z - T7-■ 

bM + b M -\z-\ -l-z M 


(19.20) 


In order to give a complete description of the LTD-system, we also have to know the 
region of convergence of the transfer function. However, the system is causal and 
for a causal system with a rational transfer function we have by theorem 19.4 that the 
degree of the numerator of H(z) is not greater than the degree of the denominator. 
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EXAMPLE 19.12 


EXAMPLE 19.13 


One can easily verify that this is satisfied for all M and N. Moreover, the region of 
convergence is the exterior of the circle in the complex plane passing through a pole 
of H(z) with maximal distance to the origin. Therefore, the region of convergence 
is known. Hence, there is only one causal LTD-system described by (19.19). 

A causal system is described by the difference equation 

y[«] — 3 y[n — 1] + 2y[n — 2] = u\n\ + u\n — 1], 

The transfer function can immediately be read off from the difference equation: 

H = 1 + z -1 = z + z 2 = z + z 2 

l—3z~ l +2z~ 2 z 2 — 3z + 2 (z — l)(z — 2) 

This has poles at z = 1 and z = 2. Because of the causality of the system, the region 
of convergence is the exterior of the circle | z | = 2. As we have seen in section 18.3, 
the impulse response can now be found by a partial fraction expansion. The result 
is 


h[n] = (3 • 2" — 2)e[n], 

◄ 


As a matter of fact, the LTD-system in the example above is not stable. For stable 
LTD-systems with a rational transfer function, the unit circle must be contained in 
the region of convergence, according to theorem 19.4. In example 19.12 this is not 
the case. 

A causal LTD-system is given by 


y[n] — 3 y[n — 1] + 3v|« — 2] — y\n — 3] = u[n — 2], 


We determine the step response a[n] as follows. The transfer function of the given 
LTD-system can easily be read off from the difference equation: 


2 


H(z) = 


1 — 3z 1 + 3z 1 — z 


-2 _ 3 


(z - l ) 3 


for | z | > 1 . 


The step response a[n\ is the response to the discrete signal e[n], whose z-transform 
equals z/(z, — 1). By (19.6) we have 


a[n] -o- 


(z - l ) 3 Z - 1 (z - l ) 4 


for | z | > 1 . 


The step response can now be found by an inverse transform, after first applying the 
partial fraction expansion technique. We then find that 


a[n] -o- 


+ 


(z - l ) 4 (z - l ) 3 (z - l ) 4 
An inverse transform then gives 


a[n] = 


f ["]■ 


for | z | > 1 . 


The system is not stable, though. The unit circle is not contained in the region of 
convergence. Also note that the step response is not bounded, while the input e[n\ 
is bounded. ^ 
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EXERCISES 

19.15 A causal LTD-system is described by the following difference equation: 
v[n 1 + jy\n - 1 ] = u[n]. 

a Calculate the impulse response of the system, 
b Calculate the response to the input u\n ] = (j)”e[n]. 
c Is the system stable? Justify your answer. 

19.16 A causal LTD-system is described by the following difference equation: 
y[n\ — y[n — 2 ] = u[n — 1 ]. 

a Calculate the transfer function of the system, 
b Is the system real? Justify your answer. 

c Calculate the response to the input u\n\ = cos (ruj>). Here tj> is a real constant. 

19.17 A causal system is described by the following difference equation: 
y\n \ - y[n — 2 ] = u[n ] + u[n - 1], 

a Calculate the impulse response of the system, 
b Is the system stable? Justify your answer, 
c Calculate the step response. 

d Calculate the response to the input u[n] = e[n] + e[n — 2], 

SUMMARY 

The LTD-systems are very well suited for the application of the z-transform and the 
Fourier transform of discrete-time signals. An important role in the theory of LTD- 
systems is played by the impulse response, the transfer function, and the frequency 
response. In the time domain or n-domain the relation between an input z/[n] and 
the corresponding response y[n] is described by the convolution product 

y[n\ = (h * «)[«]. 

Here h[?i] is the response to the discrete unit pulse <5[n]. The response h[n ] is called 
the impulse response. Applying the convolution theorem for the z-transform to the 
convolution product above immediately leads to the relation 

Y(z) = H{z)U (z), 

which can be regarded as a description of the LTD-system in the z-domain. Here 
H(z) is the z-transform of the impulse response h\n\\ H(z) is called the transfer 
function. An LTD-system is thus completely determined by the impulse response, 
or by the transfer function. One has, for example, that an LTD-system is stable or 
causal if and only if the impulse response is absolutely summable or, respectively, 
causal. Since the transfer function is the z-transform of the impulse response, the 
stability also follows from the region of convergence of H (z). If the unit circle 
in the complex plane is contained in the region of convergence of H(z), then the 
corresponding LTD-system is stable. For an LTD-system the transfer function H(z) 
can also be interpreted as the eigenvalue with eigenfunction the signal z n . In par¬ 
ticular, we have for stable systems that the response to the input e ,nco , containing 
the single frequency to, is equal to H(e ,a, )e lna> . The function H(e“°) is called the 
frequency response. The significance of the frequency response for an LTD-system 
can especially be seen in the spectra of the input and the output. This is because 

Y(e Uo ) = H(e Uo )U{e im ). 

In practice, an important category of LTD-systems is those systems that can be de¬ 
scribed by difference equations. The transfer function is then a rational function of 
z. If its poles lie inside the unit circle, then the system is stable. 
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19 Applications of discrete transforms 

SELFTEST 


19.18 

For a causal LTD-system the transfer function H (z) is given by 

H(z) = , Z+ 1 -• 

4z~ + 4z + 1 

a Calculate the impulse response /;[/;]. 

b Calculate the response to the input u[n] — (—1)”, where n e Z. 
c Is the system stable? Justify your answer, 
d Is the system real? Justify your answer. 

e Let ;/[/?] be an input with spectrum U (e uo ) = cos2c<;. Calculate the response 
y[n] to u[n]. 


19.19 

Given is a stable LTD-system. We apply a periodic input u[n\ with period N to the 
LTD-system. 

a Show that the response y[«] to u[n\ is also periodic with period N. 
b Let I/[L] and Y[k\ be the N -point DFT of i/[n] and y[n] respectively, and let 
H(z) be the transfer function of the system. Prove that y[k] = H(e l7Tlk ^ N )U[k], 


19.20 

For an LTD-system the frequency response is given by H(e lu> ) = cos 2 in. 
a Calculate the impulse response h[n], 

b To the LTD-system a periodic discrete-time signal u\n\ with period 4 is applied, 
whose 4-point DFT F[k] is given by F[0] = 1, F[l] = — 1, F[2] = 0, F[3] = 1. 
Calculate the response _y [n | to the input u[n\. 


19.21 

For a stable LTD-system the step response is given by a[n] = n 2 (j) n e[n]. 
a Calculate the transfer function and the impulse response of the system, 
b Is the system causal? Justify your answer. 

c Calculate the response to the input u[n] — e" ,a> (in a real constant). 


19.22 

A causal LTD-system is described by the following difference equation: 
y[n] — jy[n — 1] = u[n — 1 ] + u[n — 2 ], 
a Determine the step response n[n] for n > 0. 
b Is the system stable? Justify your answer. 


19.23 

A causal LTD-system is described by the following difference equation: 

6 y [ n | — 5v[« — 1] + y[n — 2] = 6 u[n\ — 6 u[n — 2\. 
a Calculate the impulse response /;[/;] of the system, 
b Determine the frequency response of the system. 

c Describe the inputs ;<[»] that are completely blocked by the system, that is to 
say, whose response y[n\ is identically zero. 


19.24 

For a stable LTD-system the frequency response is given by H ( e uo ) = 1 + 2 cos cn + 
cos 2 ai. 

a Calculate the impulse response /;[n] of the system. 

b To the system we apply the input u[n\ whose spectrum U(e la> ) is given by 
U(e ,a> ) = 1 + sinw + sin2a>. Let y[n] be the response to the given input u[n]. 
Calculate the energy-content of the signal y[n}. 
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There is an overwhelming amount of literature available on Fourier and Laplace 
transforms. In it, one can roughly distinguish two main trends. On the one hand the 
theoretical literature for a mathematically oriented audience, on the other hand the 
literature where the applications play a central role. In much of the literature aimed 
at the applications, the results are presented without precise conditions or proofs. 
The mathematical literature, however, is mostly of a very theoretical nature and 
assumes quite a lot of prerequisites, such as the so-called Lebesgue integral. In the 
following survey one will find very few books from the latter category. A number 
of the books mentioned below do require a mathematical background which goes 
beyond what we have assumed for this book. Two rather elementary standard books 
on mathematical analysis, which could be consulted in order to obtain the required 
background, are for example (these books are available in several editions): 

Apostol. T.M., Mathematical analysis. Reading, Addison-Wesley, 1957. 
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Fourier and Laplace transforms. 

Bracewell, R.N., The Fourier transform and its applications. New York, McGraw- 
Hill, 1986, 2nd ed., revised. 
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the standard works in the field of the applications of the Fourier integral, especially 
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transform and the Fast Fourier Transform (FFT) are also treated extensively. 

Brigham, E.O., The fast Fourier transform. Englewood Cliffs, Prentice-Hall, 1974. 
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termination of the discrete Fourier transform using the FFT is then treated very thor¬ 
oughly. This book is a standard work on the FFT. 

Churchill, R.V. and J.W. Brown, Fourier series and boundary value problems. New 
York, McGraw-Hill, 1978, 3rd ed. 

Applying Fourier analysis to boundary value problems (see sections 5.2 and 10.4) 
is the central issue. Although emphasis is put on Fourier series, more general series 
of orthogonal functions and the Fourier integral are treated as well. 

Doetsch, G., Einfiihrung in Theorie und Anwendung der Laplace Transformation. 
Basel, Birkhauser Verlag, 1958 (in German). 

Doetsch, G., Guide to the applications of Laplace transforms. London, Van 
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The book mentioned first gives a very thorough treatment of the Laplace trans¬ 
form. Although only the Riemann integral is used, this book does assume a solid 
mathematical background. The Laplace transform of distributions is also treated, 
but it is assumed that the reader is familiar with the theory of distributions. Appli¬ 
cations to differential equations are treated extensively. The second book is in fact 
a very compact version of the first one. The most relevant results are given without 
proof. The book then concentrates on the applications to differential and difference 
equations. 

Dym, H. and H.R McKean, Fourier series and integrals. New York, Academic 
Press, 1972. 

This book requires a good mathematical background and uses the so-called 
Lebesgue integral (the only book in this survey which does), although this theory is 
explained in the first chapter. We mention this book mainly because it is considered 
as one of the standard works as far as the theory of Fourier series and Fourier inte¬ 
grals is concerned. It also contains a whole range of applications of Fourier analysis 
in mathematics and physics. 

Enden, A.W.M. van den and N.A.M. Verhoeckx, Digitate signaalbewerking. Over- 
berg (gem. Amerongen), Delta Press, 1987 (in Dutch). 

This book (in Dutch) treats in a well-organized manner discrete systems and sev¬ 
eral discrete transforms. The theory is then applied to the design of discrete filters. 
Moreover, problems are discussed that arise when processing signals of finite word 
length. These are discrete signals whose values are discrete as well. The book is 
clearly aimed at the applications. The style is clear and it points the reader at impor¬ 
tant aspects of several of the transforms. Mathematical rigour is comparable to what 
is normally seen in mathematics books for engineers. When studying part 5 of our 
book, van den Enden and Verhoeckx is recommended to those who are interested in 
the style of the people who apply this material. 

Hanna, J. and J.H. Rowland, Fourier series , transforms and boundary value 
problems. New York, Wiley, 1990. 

A clearly written introduction to partial differential equations, mainly aimed at 
students in the technical sciences and engineering. Clear physical motivations are 
given of the equations under consideration, as well as of the interpretations of the 
obtained solutions. One also discusses, for example, existence and uniqueness of 
the solutions of the heat equation and the wave equation at an elementary level. 

Korner, T.W., Fourier analysis. Cambridge, Cambridge University Press, 1990. 

A book covering a wide variety of subjects and consisting of some hundred short 
chapters (‘essays’). Alternately the theories of Fourier series and the Fourier integral 
are developed and a large number of different applications is treated (a small sample: 
approximation, the age of the earth, the transatlantic cable, the heat equation). 

Papoulis, A., Circuits and systems. New York, Holt, Rinehart & Winston, 1980. 

Of the large number of books on linear systems we only mention here this well- 
known book by Papoulis. It is quite comprehensive and treats both analogue and 
digital systems, and all transforms treated by us occur in it (Laplace transform, 
z-transform, Fourier series, Fourier integral, discrete Fourier transform, and FFT). 
There is a strong emphasis on the practical applications in electrical circuits and 
networks. 

Papoulis, A., Signal analysis. Singapore, McGraw-Hill, 1984. 

Again we only mention the book by Papoulis as one of the standard works in the 
vast amount of literature on signal analysis. Again all transforms treated by us occur 
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in it. Here there is a strong emphasis on the applications in signal analysis: filters, 
windowing and data smoothing are some of the main subjects. 

Senior, T.B.A., Mathematical methods in electric engineering. Cambridge, 
Cambridge University Press, 1986. 

In this book the emphasis is on the Laplace transform and the applications to 
systems theory. The theory of complex functions, necessary in order to use the fun¬ 
damental theorem of the Laplace transform (see section 13.5), is treated extensively. 
Besides this, Fourier series and the Fourier integral are treated in some detail. 

Spiegel, M.R., Schaum’s outline of theory and problems of Fourier analysis with 
applications to boundary value problems. New York, McGraw-Hill, 1976. 

Spiegel, M.R.. Schaum’s outline of theory and problems of Laplace transforms. New 
York, McGraw-Hill, 1965. 

These are two books from the well-known ‘Schaum’s outline' series. After a 
short summary of the most well-known results from the theory and the applications, 
worked examples follow, together with a large number of exercises. In the first book 
the emphasis is on Fourier series, the Fourier integral and the applications to bound¬ 
ary value problems (as in the previously mentioned book by R.V. Churchill and J.W. 
Brown). In the second book the emphasis is on the Laplace transform and the appli¬ 
cation to differential equations. Complex function theory is also treated briefly. Part 
of the material on Fourier series and the Fourier integral from the first book can also 
be found in the second book. These books are very suitable as practising material. 

Tolstov, G.P., Fourier series. New York, Dover, 1962. 

This book is mainly devoted to a thorough treatment of the theory of the Fourier 
series. Still, it is of an elementary character, meaning that one can read it with a 
minimum of mathematical prerequisites. Besides Fourier series, the Fourier integral 
is treated briefly, as well as other series of orthogonal functions. 

Walker, P.L., The theory of Fourier series and integral. Chicester, Wiley, 1986. 

One of the few books on Fourier series and the Fourier integral in this survey 
with a theoretical character, but which does not use the so-called Lebesgue integral. 
Therefore, this book is also intended for engineering students. 

Zemanian, A.H., Distribution theory and transform analysis. New York, Dover, 
1987. 

It is quite hard to find an elementary book on distribution theory. This book 
contains a very comprehensive treatment of the distribution theory that is still very 
accessible. Besides the general theory, both the Fourier transform and the Laplace 
transform of distributions are treated. 
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TABLE 1 Fourier coefficients of periodic functions with period 
T = 2n/a>o 


no. 

fit) 

i r T/2 ■ , 

Cn = i me-'™*'* 

1 J-T/2 

condition(s) 

1 

Pa,Tit) 

2sm(na)(\a/2) a 

- 1 c 'o — — 

ucoqT T 

0 <a <T 

2 

Va.Tit) 

4sin 2 (ncooa/2) a 

2 2 t ’ c 0 — T 

H^COqCiT 1 

0 < a < T/2 

3 

2 t/T 

a- d" n 

> c 0 = 0 
nn 
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TABLE 2 Properties of the Fourier transform of periodic functions 


no. 

fit), git) 

c n ■> dn 

condition/s) 

1 

a fit) + bg(t) 

ac n + bd n 

a, b e C 

2 

W) 

C—n 


3 

fit - t 0 ) 

e -ino) 0 t 0cn 

t 0 e R 

4 

f(-0 

C—n 


5 

f(t) even and real 

c n even and real 


6 

f(t) odd and real 

c n odd and imaginary 


7 

fit)g(t) 

oo 

y ] c kdn—k 

k=—o o 


8 

if * g)(t ) 

c ndn 


9 

f fit)di: 

J-T/2 

c n 

incoQ 

O 

II 

O 

10 

fit) 

in(i)QC n 



11 

12 


1 

T 

1 

T 


L 

l 


T/2 

-T/2 

T/2 

-T/2 


oo 

f(t)g(t)dt= ^2 c„d„ 
n =—oo 

oo 

\f( t )\ 2 dt= J2 i c »i 2 

n=—oo 
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TABLE 3 Fourier transforms of non-periodic functions 


no. 

m 

rOO 

F(co) = / /(t)e- ,(ur dt 

J—oo 

condition( s) 

1 

Pa(t ) 

2 sin(act)/ 2 ) 

a > 0 

2 

sin at 

t 

np 2 a(tt>) 

a > 0 

3 

q a (t) 

4 sin 2 (aat/2) 
aco^ 

a > 0 

4 

. 7 

sin at 

1 2 

jtaq 2a {a>) 

a > 0 

5 


2 a 

a- + a > 2 

a > 0 

6 

1 

a 2 + t- 

a 

a > 0 

7 

e(t)e~ at 

1 

a + tat 

Rea > 0 

8 

e(t)te~ a ’ 

1 

(a + ia>) 2 

Rea > 0 

9 

e{t)e~ at sin bt 

b 

(a + ia >) 2 + b 2 

Rea > 0, b e R 

10 

e(t)e~ at cos bt 

a + tat 

(a + ia>) 2 + Z ? 2 

Rea >0,iel 

11 

e~at 2 

[l[ e -(0 2 /4a 

V a 

a > 0 
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TABLE 4 Properties of the Fourier transform of non-periodic functions 


no. 

fit), git) 

Fico), G(cu) 

condition(s) 

1 

a fit) + bg(t) 

aFia>) + bGico) 

a, b e C 

2 

W) 

Fi-co) 


3 

fit - a ) 

e~ i(oa Fi(o) 

a e R 

4 

e ia 'f(t) 

Fico — a) 

a e R 

5 

fiat) 

| a |“ 1 F(a~ l a>) 


6 

fit) even and real 

F(a>) even and real 


7 

/(f) odd and real 

Fiat) odd and imaginary 


8 

f {n \t) 

iico) n Fico) 


9 

i—it) n fit) 

F (n) (w) 


10 

f fit) dr 

J—oo 

Fico) 

ico 

F( 0) = 0 

11 

Fi-t) 

2 Ttfico) 


12 

if * 8) it) 

F ico) G ico) 


13 

fiOgit) 

2-iF*G)ia>) 

2tt 



14 

15 


/: 

/: 


f(t)g(t) dt = 

I /(*) \ 2 dt = 
1 


E /(" r ) = 


1 

2n 

1 

2n 


/_ 

l 


F(a>)G(a >) tto 
| F(u)\ 2 dco 



16 


(T > 0) 
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TABLE 5 Fourier transforms of distributions 


no. 

T(t) 

U(co) = {U, f) = (T, T<S>) 

conditionf s) 

i 

m 

1 


2 

i 

2nS(a>) 


3 

S(t — a) 

g—iaco 

a el 

4 

e iat 

2nS(a> — a) 

net 

5 

cos at 

n(S(a> — a) + S(a> + a)) 

a e R 

6 

sin at 

—ni(8(a> — a) — S(a> + a)) 

ael 

7 

V(t) 

oo 

= J2 S(t — Ic) 

k= — oo 

Hi) 

OO 

= 2tt 8(co — 2nk) 

k=—oo 


8 

pv(l/0 

—nisgnco 


9 

sgnt 

—2 /pv(l/a>) 


10 

e(t) 

nS(a>) — tpv(l/co) 


11 

S (n) 

(ia)) n 



12 


t‘ 


27ti"S ( "\w) 
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TABLE 6 Properties of the Fourier transform of distributions 


no. 

Tit), S{t) 

U(a>), V(co) 

condition(s) 

1 

aT(t) + bS(t) 

aU (co) + bV (co) 

a,b e C 

2 

T (t — a) 

e ~ iaa, U(co) 

nel 

3 

e' a, T(t) 

U(u> — a) 

a e R 

4 

T (at) 

|a| _1 U (a~ l a>) 

a€l,«/0 

5a 

T (t) even 

U (to) even 


5b 

T (t) odd 

U(to) odd 


6 

T (n) (t) 

(ico) n U(co) 


7 

i-it) n T(t) 

U (n) (ao) 


8 

U(-t) 

2nT(to) 


9 

(T * S)(t) 

U (co) V (to) 


10 

T (t)S(t) 

^—(U* V)(co) 

2tc 
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TABLE 7 Laplace transforms of causal functions 


no. 

fit) 

F(s) = (£f)(s) 

= fo° f (t)e~ st dt 

half-plane of 

convergence 

condition) s) 

1 

1 

1 

5 

Re 5 > 0 


2 

e at 

1 

s — a 

Re 5 > Rea 

ff 6 C 

3 

t n 

n\ 

s n+l 

Re 5 > 0 


4 

sin at 

a 

s 2 + a 2 

Re 5 > 0 

set 

5 

cos at 

5 2 + fl 2 

Re 5 > 0 

ael 

6 

sinhaf 

a 

s 2 — a 2 

Res > a 

ael 

7 

coshflf 

s 2 -a 2 

Res > a 

ael 

8 

sin (at + b) 

a cos b + 5 sinfc 

s 2 + a 2 

Res > 0 

a,b e R 

9 

cos {at + b) 

s cos b — a sinfe 

S 2 + ft 2 

Res > 0 

a, b e R 

10 

t n e -at 

ft! 

0 + a ) n+1 

Re 5 > Re (—a ) 

a e € 

11 

e(t — a) 

e -as 

s 

Re 5 > 0 

a > 0 
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TABLE 8 Properties of the Laplace transform of causal functions 


no. 

fit), git) 

Fis), G(s) 

condition!s) 

1 

af(t) + bg(t) 

aF(s) + bG(s) 

a, b e C 

2 

'S' 

1 

'S' 

1 

w 

e~ as F(s) 

a > 0 

3 

e at f(t) 

F(s — a) 

a £ C 

4 

fiat) 

a -1 F(a —1 s) 

a > 0 

5 

f (n \t) 



6 

(-l)"t"/(0 



7 

f fir) dr 

Jo 

Fjs) 

s 


8 

if * 8) it) 

Fis)G(s) 


9 

fit) 

fo fit)e~ s ‘dt 

1 - e~ sT 

/(r + n = /(o 


10 lira sF(s) = /(0+) 

s —>oo 

lint f(t) = lim sF(s) 
t->o o j-j -0 


11 
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TABLE 9 Laplace transforms of distributions 


no. 

T(t) 

U(s)=(T(t),e~ s ') 

condition(s) 

1 

<5(0 

1 


2 

s (,, Ht) 

s n 


3 

S(t — a) 

e -as 

a > 0 

4 

g( n \t-a ) 

s n e~ as 

a > 0 


TABLE 10 Properties of the Laplace transform of distributions 


no. 

T(t), S(t) 

U(S), V(5) 

conditions) 

1 

aT(t) + bS(t) 

aU(s) + bV(s) 

a, b e C 

2 

T(t — a) 

e~ as U (s) 

a > 0 

3 

T (n \t) 

s n U(s) 


4 

( T*S)(t ) 

U(s)V(s) 



TABLE 11 Discrete Fourier transforms of periodic discrete-time signals with 
period N 


no. f[n ] 

1 %[«] 

2 e 2ninl/N 

m 

3 y, s Ni"-n 

l=—m 


F[k] = E,i“o fln\e- 2 ” M ' N 


NS N [k-l] 


2m + 1 if k is a multiple of N 

sin((2 m + 1) kn/N) 

-:-otherwise 


condition(s) 


0 < m < y 


sm(kjt/N) 
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TABLE 12 Properties of the discrete Fourier transform of 
periodic discrete-time signals 


no. 

/[«], gD*] 

FW, GW 

condition!s) 

1 

af[n] + bg[n] 

aF[it] + feG[ifc] 

a,b e C 

2 

7M 

F[-fc] 


3 

/[« -/I 

e -2wi7fc/lV F [^ 

/ e Z 

4 


F[fc - l] 

/ e Z 

5 

/[-«] 

F[-k] 


6 

F[«] 

Nfl-k] 


7 

(/ * g)M 

F\k\G\k\ 


8 

/[«]§[«] 

F*G)[k] 



N -1 j N -1 

9 J2 fWgW = - E 

n=0 ™ k =0 

N -1 , A-l 

Ei /["]| 2 = ^ Ei f mi 2 

77=0 /t=0 


10 
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TABLE 13 ^-transforms of non-periodic discrete-time signals 



oo 

conver¬ 


fin] 

F(z)= J2 f [n]z ~ n 

gence 

condition( s ) 


n=—o o 
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S\n\ 

1 

zeC 


a n e[n] 

Z 

z — a 

1 z I > I« I 

a e C 

a n e[—n — 1] 

—z 

z — a 

1 z I < I« I 

a e C 

(k) a " eM 

a k z 

\z\ > \a\ 

seC,leN 

(z — a) k+i 

Qa n e[-n- l] 

—a k z 

\z\ < \a\ 

a e C, k g N 

(z — a) k+l 

cos(a>o n + 4>o)e[n ] 

z 2 cos <j>o~z cos(0 o -(wo) 

1 z | > 1 

(1)Q, (pQ G ]R 

z 2 -2z coswq+I 


TABLE 14 Properties of the z-transform of non-periodic discrete-time signals 


no. 

fin], gin] 

F(z). G(z) 

condition (s ) 

1 

af[n] + bg[n] 

aF(z) + bG(z) 

a, b e C 

2 

/[-»] 

F(l/z) 


3 

7w 

fff) 


4 

fin - l] 
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I e Z 
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a 11 fin] 

F(z/a) 
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6 
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d 
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dz 


7 
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TABLE 15 Properties of the Fourier transform of non-periodic discrete-time 
signals 


no. 

/[«]. g[«l 
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abscissa 

of absolute convergence, 271 
of convergence, 273 
absolute convergence, 47 
absolute value, 29 
absolutely 
convergent, 268 
integrable, 142 
summable, 401 

algorithm for an N\N 2 --point DFT, 

379 

aliasing problem, 351 

all-pass system, 121, 237 

amplitude, 12, 13, 68 

amplitude response, 19 

amplitude spectrum, 71, 141, 364, 422 

analytic function, 259 

anti-causal part, 393 

argument, 12, 30 

autocorrelation, 161, 387, 409 

band-limited signal, 238, 347 
band-pass filter, 238 
Bernoulli paradox, 263 
Bessel’s inequality, 87 
bit reversal, 383 
block function, 144 
blocked frequency, 119 
boundary condition, 123, 330 
bounded function, 42 
bounded signal, 20 
butterfly, 381 

Cartesian coordinates, 29 
Cartesian form, 29 
cascade system, 23, 234 
Cauchy distribution, 177 
Cauchy principal value, 166 
Cauchy-Riemann equations, 264 
causal, 16, 417 
distribution, 301 
part, 393 

periodic function, 294 
system, 21 
chain rule, 41, 260 
characteristic equation, 117 


characteristic polynomial, 116 
circle of convergence, 54 
comb distribution, 214 
comparison test, 47 
complex 

conjugate, 29 
cosine, 256 
exponential, 255 
Fourier coefficients, 69 
Fourier series, 69 
function, 253 
plane, 29 
signal, 11 
sine, 256 

complex-valued function, 39 
conjugation, 77, 150, 365, 397, 408 
continuity, 41 
in C, 257 
of spectrum, 155 
continuous spectrum, 142 
continuous-time signal, 11 
continuous-time system, 17 
convergence 
absolute, 47 
circle, 54 
of sequence, 45 
of series, 46 
pointwise, 50 
radius, 54 
region, 393 
tests, 47 
uniform, 183 
convolution, 158 
cyclical, 369 
fast, 387 
in ^-domain, 369 
in n -domain, 369, 408 
in w-domain, 408 
of causal functions, 289 
of discrete-time signals, 405 
of distributions, 224 
of periodic functions, 97 
convolution theorem, 160, 302 
for distributions, 225 
in frequency domain, 177 


Laplace transform, 289 
Z-transform, 405 
critical damping, 321 
cross-correlation, 161, 387 
cut-off frequency, 235 
cyclical convolution, 369 

D’Alembert’s ratio test, 49 
damped vibration, 321 
damping theorem, 278 
De Moivre’s formula, 31 
definite integral, 43 
delta function, 193 
delta function at a, 194 
derivative, 259 
left-hand, 42 
of 8 (0,200 
of distribution, 199 
of 6(r), 199 
right-hand, 42 
detection filter, 417 
DFT, 360 

difference equation, 425 
differentiability, 41 
inC, 259 
differentiation 

in frequency domain, 154, 219 
in ^-domain, 282, 283 
in time domain, 153, 218, 281, 299 
in z-domain, 398 
of Fourier series, 101 
diffusion equation, 123 
dilation, 151 

Dirac delta function, 194 
Dirichlet kernel, 89 
discrete Fourier transform, 360 
fundamental theorem, 362 
discrete spectrum, 71, 142, 360 
discrete unit pulse, 341 
discrete unit step function, 343 
discrete-time signal, 11 
discrete-time system, 17 
distortion free system, 231 
distribution, 193 
causal, 301 
convolution, 224 
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convolution theorem, 225 
derivative, 199 
equality, 195 
even, 205 

Fourier transform, 209 
Laplace transform, 301 
odd, 205 
on 8, 225 

product with polynomial, 203 
scaling, 205 
shifted, 217 
spectrum, 209 
time reversal, 205 
divergence of sequences, 45 
domain, 253 
duality, 175, 371 

eigenfrequency, 117 
eigenfunction, 117, 125, 

421 

eigenvalue, 125, 421 
electric network, 8 
energy spectrum, 141 
energy-content, 179, 408 
continuous-time, 15 
discrete-time, 15 
energy-signal, 179 
continuous-time, 15 
discrete-time, 15 
equality of distributions, 

195 

Euler’s formula, 12, 31 
even function, 72, 151 
exponential form, 31 
exponential order, 272 

fast convolution, 387 
filter, 119 
band-pass, 238 
detection, 417 
low-pass, 235,423 
final value theorem, 293 
forced series development, 81 
formal solution, 124, 245 
Fourier coefficients, 66 
complex, 69 

of convolution product, 98 
of product, 96 
Fourier cosine series, 80 
Fourier cosine transform, 152 
Fourier integral, 142 

fundamental theorem, 169 
Fourier series, 66 


complex, 69 
differentiation, 101 
fundamental theorem, 90 
integration, 100 
Fourier sine series, 80 
Fourier sine transform, 152 
Fourier transform, 66, 141, 209 
discrete-time signal, 408 
of distribution, 209 
frequency, 12, 13 
blocked, 119 
cut-off, 235 
fundamental, 61, 363 
Nyquist, 347 
sampling, 341 
frequency domain, 71, 141, 

360 

frequency response, 19, 235, 
421 

function as distribution, 194 
fundamental 

frequency, 61, 363 
homogeneous solution, 117 
solution, 126 
fundamental theorem 
even functions, 171 
odd functions, 171 
of discrete Fourier transform, 
362 

of Fourier integral, 169 
of Fourier series, 90 
of Laplace transform, 303 

Gauss function, 147 
generalized functions, 194 
geometric series, 46 
Gibbs’ phenomenon, 105 

half-infinite string, 330 
harmonic oscillator, 320 
harmonic series, 47 
heat equation, 123, 244 
Heaviside function, 141 
homogeneous solution, 117 
hyperbolic cosine, 256 
hyperbolic sine, 256 

ideal low-pass filter, 235, 423 
imaginary axis, 29 
imaginary part, 28 

of complex function, 255 
impulse response, 231, 413 
infinitely differentiable, 156 
initial 


condition, 123, 330 
phase, 12, 13, 68 
rest, 315 

initial value theorem, 292 
integration 

in time domain, 155, 284 
of Fourier series, 100 
integrator, 233 

invariant under Fourier transform, 

157 

inverse DFT, 363 
inverse Fourier transform, 170 
inverse Laplace transform, 304 
inverse system, 243 
inversion formula, 170, 304 
inversion theorem, 304 

jump-formula, 201 

^-domain, 360 

Laplace transform, 268 
and convolution, 300 
distribution, 301 
fundamental theorem, 303 
of periodic function, 295 
one-to-one, 304 
two-sided, 274 
left-hand derivative, 42 
left-hand limit, 41 
limit 
in C,257 
left-hand, 41 

of complex-valued function, 40 
right-hand, 41 
line spectrum, 71, 142 
linear 

homogeneous condition, 124 
interpolation, 345 
phase shift, 367 
system, 17 

time-invariant system, 18 
linearity, 76, 149, 259, 275, 299, 396, 
408,413 

low-pass filter, 235, 423 
LTC-system, 114, 230 
LTD-system, 413 

mechanical system, 9 
modulation theorem, 151 
modulus, 12, 29 
multiplication by t k , 283 
multiplicity, 32 
multiplier, 415 
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n -domain, 360 
neighbourhood, 257 
non-recursive system, 425 
normal distribution, 176 
Af-point DFT, 360 

Af-point discrete Fourier transform, 360 
nth harmonic, 67 
nth roots of unity, 33 
null-signal, 11 
number of operations 
2 m -point DFT, 381 
-point DFT, 380 
Nyquist frequency, 347 

odd function, 72, 151 
order 

of differential equation, 115 
of pole, 36, 400 
orthogonal, 64 
overcritical damping, 321 
overdamped, 321 
overshoot, 105, 107 

Parseval’s identity, 99, 179, 408 
Parseval’s theorem, 370 
partial sum, 46 
particular solution, 117 
pass-band, 423 
periodic 

block function, 72 
continuous-time signal, 12 
discrete-time signal, 12 
extension, 62 

train of discrete unit pulses, 343 
phase factor, 150 
phase response, 19 
phase spectrum, 71, 141, 364, 422 
piecewise continuous function, 41 
piecewise smooth function, 42 
Plancherel’s identity, 179 
pointwise convergence, 50 
Poisson’s summation formula, 181 
polar coordinates, 29 
polar form, 29 
pole, 36, 400 
order, 36 

polynomial, 32, 254 
power, 370 

continuous-time, 15 
discrete-time, 15 
periodic continuous-time, 15 
periodic discrete-time, 15 


power of piecewise smooth periodic 
function, 99 
power series, 52 
power spectrum, 387 
power-signal 

continuous-time, 15 
discrete-time, 15 
principal value 1 /t, 196 
probability distribution, 176 
product rule, 259 

quotient rule, 260 

radius of convergence, 54 
range, 253 

rapidly decreasing function, 156 
ratio test, 49 
rational function, 254 
real 

axis, 29 
signal, 11 

system, 20, 119, 417 
real part, 28 

of complex function, 255 
reciprocity, 175, 219, 365 
reconstruction, 344 
rectangular pulse function, 144 
recursive system, 425 
reduced neighbourhood, 257 
region of convergence, 393 
resonance, 118 
response, 10 
amplitude, 19 
frequency, 19, 235, 421 
impulse, 231, 413 
phase, 19 
step, 233, 417 

Riemann-Lebesgue lemma, 88, 165 
right-hand derivative, 42 
right-hand limit, 41 
root, 32 

running average, 413 

samples, 341 
sampling, 215, 341 
condition, 347 
frequency, 341 
period, 341 
scaling, 278 
in time domain, 151 
in ^-domain, 398 
of distribution, 205 
Schwartz, 194 


5-domain, 268 
selfduality, 152 
separation of variables, 124 
shah distribution, 214 
shift 

in frequency domain, 150 
in ^-domain, 368 
in n-domain, 366, 397, 408 
in w-domain, 408 
in 5-domain, 277 
in time domain, 78, 150, 277, 301 
property for distributions, 218 
shifted distribution, 217 
sifting property, 193 
sign function, 196 
signal, 9 

band-limited, 238, 347 
bounded, 20 
causal, 16 
complex, 11 
continuous-time, 11 
discrete-time, 11 
energy-, 15, 179 
finite switch-on time, 394 
null-, 11 

periodic continuous-time, 12 
periodic discrete-time, 12 
power-, 15 
real, 11 
sinusoidal, 12 
switched-on periodic, 220 
time-harmonic continuous-time, 13 
time-harmonic discrete-time, 13 
simple zero, 32 
sine integral, 106 
sinusoidal function, 61 
sinusoidal signal, 12 
spectral amplitude density, 141 
spectral density, 141 
spectral energy density, 141 
spectrum, 71, 141 
amplitude, 71, 141, 364, 422 
complex conjugate, 150 
continuous, 142 
discrete, 71, 142, 360 
discrete-time signal, 408 
energy, 141 
line, 71, 142 
of 1,210 
of 5(0, 210 
of 8(t — a), 211 
of 218 
of distribution, 209 
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of 6(0, 219 
of 211 

of periodic function, 213 
of pv(l/0, 212 
of sgn t, 219 
of W,215 

of switched-on periodic signal, 220 
phase, 71, 141,364, 422 
power, 387 
square integrable, 177 
stable system, 20, 119, 319, 415 
stationary phase, 127 
step response, 233, 417 
sum of a series, 46 
superposition, 231, 342 

of fundamental solutions, 126 
superposition rule, 115, 231 
switch-on time, 16 
switched-on 

periodic signal, 220 
system, 312 
system, 10 

all-pass, 121, 237 
cascade, 23, 234 
causal, 21 

continuous-time, 17 


discrete-time, 17 
distortion free, 231 
inverse, 243 
linear, 17 

linear time-invariant, 18 
LTC-, 114, 230 
LTD-,413 
non-recursive, 425 
real, 20, 119,417 
recursive, 425 
stable, 20, 119,319,415 
switched-on, 312 
time-invariant, 18 
system function, 19, 235, 312 

time domain, 71, 141 
time reversal, 79, 151, 365, 397 
of distribution, 205 
time window, 384 
time-delay unit, 414 
time-harmonic 

continuous-time signal, 13 
discrete-time signal, 13 
time-invariant, 413 
time-invariant system, 18 
train of delta functions, 215 


transfer function, 19, 235, 312, 419 

transform pair, 395 

trapezium function, 162 

trapezoidal rule, 357 

triangle function, 145 

triangle inequality, 30 

trigonometric polynomial, 62 

trigonometric series, 62 

trivial solution, 117 

twiddle factors, 378 

two-sided Laplace transform, 274 

undercritical damping, 321 
uniform convergence, 183 
uniqueness theorem, 93, 173 
unit circle, 29 
unit disc, 256 

unit step function, 141, 195 

wave equation, 127 

z-domain, 395 
zero, 32 
multiplicity, 32 
simple, 32 

zero-order interpolation, 347 
z-transform, 392, 395 



